Nov 10 23:55:15 user nova-compute[75279]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75279) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75279) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75279) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 23:55:15 user nova-compute[75279]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:55:15 user nova-compute[75279]: INFO nova.virt.driver [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 23:55:15 user nova-compute[75279]: INFO nova.compute.provider_config [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Acquiring lock "singleton_lock" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Acquired lock "singleton_lock" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Releasing lock "singleton_lock" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Full set of CONF: {{(pid=75279) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ******************************************************************************** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Configuration options gathered from: {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ================================================================================ {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] allow_resize_to_same_host      = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] arq_binding_timeout            = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] backdoor_port                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] backdoor_socket                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] block_device_allocate_retries  = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] block_device_allocate_retries_interval = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cert                           = self.pem {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute_monitors               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] config_dir                     = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] config_drive_format            = iso9660 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] config_source                  = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] console_host                   = user {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] control_exchange               = nova {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cpu_allocation_ratio           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] daemon                         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] debug                          = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_access_ip_network_name = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_availability_zone      = nova {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_ephemeral_format       = ext4 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_green_pool_size        = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] default_schedule_zone          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] disk_allocation_ratio          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] enable_new_services            = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] enabled_ssl_apis               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] flat_injected                  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] force_config_drive             = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] force_raw_images               = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] graceful_shutdown_timeout      = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] heal_instance_info_cache_interval = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] host                           = user {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_build_timeout         = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_delete_interval       = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_name_template         = instance-%08x {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_usage_audit           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_usage_audit_period    = month {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] internal_service_availability_zone = internal {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] key                            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] live_migration_retry_count     = 30 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_config_append              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_dir                        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_file                       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_options                    = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_rotate_interval            = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_rotate_interval_type       = days {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] log_rotation_type              = none {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] long_rpc_timeout               = 1800 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_concurrent_builds          = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_concurrent_live_migrations = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_concurrent_snapshots       = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_local_block_devices        = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_logfile_count              = 30 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] max_logfile_size_mb            = 200 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] maximum_instance_delete_attempts = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metadata_listen                = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metadata_listen_port           = 8775 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metadata_workers               = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] migrate_max_retries            = -1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] mkisofs_cmd                    = genisoimage {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] my_ip                          = 10.0.0.210 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] network_allocate_retries       = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] osapi_compute_listen_port      = 8774 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] osapi_compute_unique_server_name_scope =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] osapi_compute_workers          = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] password_length                = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] periodic_enable                = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] periodic_fuzzy_delay           = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] pointer_model                  = ps2mouse {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] preallocate_images             = none {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] publish_errors                 = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] pybasedir                      = /opt/stack/nova {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ram_allocation_ratio           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rate_limit_burst               = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rate_limit_except_level        = CRITICAL {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rate_limit_interval            = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reboot_timeout                 = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reclaim_instance_interval      = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] record                         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reimage_timeout_per_gb         = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] report_interval                = 120 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rescue_timeout                 = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reserved_host_cpus             = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reserved_host_disk_mb          = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reserved_host_memory_mb        = 512 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] reserved_huge_pages            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] resize_confirm_window          = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] resize_fs_using_block_device   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] resume_guests_state_on_host_boot = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rpc_response_timeout           = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] run_external_periodic_tasks    = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] running_deleted_instance_action = reap {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] running_deleted_instance_timeout = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler_instance_sync_interval = 120 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_down_time              = 720 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] servicegroup_driver            = db {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] shelved_offload_time           = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] shelved_poll_interval          = 3600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] shutdown_timeout               = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] source_is_ipv6                 = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ssl_only                       = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] state_path                     = /opt/stack/data/nova {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] sync_power_state_interval      = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] sync_power_state_pool_size     = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] syslog_log_facility            = LOG_USER {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] tempdir                        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] timeout_nbd                    = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] transport_url                  = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] update_resources_interval      = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_cow_images                 = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_eventlog                   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_journal                    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_json                       = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_rootwrap_daemon            = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_stderr                     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] use_syslog                     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vcpu_pin_set                   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plugging_is_fatal          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plugging_timeout           = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] virt_mkfs                      = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] volume_usage_poll_interval     = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] watch_log_file                 = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] web                            = /usr/share/spice-html5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_concurrency.disable_process_locking = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.auth_strategy              = keystone {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.compute_link_prefix        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.dhcp_domain                = novalocal {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.enable_instance_password   = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.glance_link_prefix         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.instance_list_per_project_cells = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.list_records_by_skipping_down_cells = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.local_metadata_per_cell    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.max_limit                  = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.metadata_cache_expiration  = 15 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.neutron_default_tenant_id  = default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.use_forwarded_for          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.use_neutron_default_nets   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_dynamic_targets = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_jsonfile_path   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.backend_argument         = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.config_prefix            = cache.oslo {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.dead_timeout             = 60.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.debug_cache_backend      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.enable_retry_client      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.enable_socket_keepalive  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.enabled                  = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.expiration_time          = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.hashclient_retry_attempts = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_dead_retry      = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_password        =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_sasl_enabled    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.memcache_username        =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.proxies                  = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.retry_attempts           = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.retry_delay              = 0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.socket_keepalive_count   = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.socket_keepalive_idle    = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.socket_keepalive_interval = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.tls_allowed_ciphers      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.tls_cafile               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.tls_certfile             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.tls_enabled              = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cache.tls_keyfile              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.auth_section            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.auth_type               = password {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.cafile                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.certfile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.collect_timing          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.cross_az_attach         = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.debug                   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.endpoint_template       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.http_retries            = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.insecure                = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.keyfile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.os_region_name          = RegionOne {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.split_loggers           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cinder.timeout                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.cpu_dedicated_set      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.cpu_shared_set         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.image_type_exclude_list = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.resource_provider_association_refresh = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.shutdown_retry_interval = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] conductor.workers              = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] console.allowed_origins        = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] console.ssl_ciphers            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] console.ssl_minimum_version    = default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] consoleauth.token_ttl          = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.cafile                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.certfile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.collect_timing          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.connect_retries         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.connect_retry_delay     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.endpoint_override       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.insecure                = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.keyfile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.max_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.min_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.region_name             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.service_name            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.service_type            = accelerator {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.split_loggers           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.status_code_retries     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.timeout                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] cyborg.version                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.backend               = sqlalchemy {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.connection            = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.connection_debug      = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.connection_parameters =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.connection_recycle_time = 3600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.connection_trace      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.db_inc_retry_interval = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.db_max_retries        = 20 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.db_max_retry_interval = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.db_retry_interval     = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.max_overflow          = 50 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.max_pool_size         = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.max_retries           = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.mysql_wsrep_sync_wait = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.pool_timeout          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.retry_interval        = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.slave_connection      = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] database.sqlite_synchronous    = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.backend           = sqlalchemy {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.connection        = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.connection_debug  = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.connection_parameters =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.connection_recycle_time = 3600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.connection_trace  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.db_inc_retry_interval = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.db_max_retries    = 20 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.db_max_retry_interval = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.db_retry_interval = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.max_overflow      = 50 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.max_pool_size     = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.max_retries       = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.pool_timeout      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.retry_interval    = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.slave_connection  = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] api_database.sqlite_synchronous = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] devices.enabled_mdev_types     = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ephemeral_storage_encryption.enabled = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.api_servers             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.cafile                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.certfile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.collect_timing          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.connect_retries         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.connect_retry_delay     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.debug                   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.default_trusted_certificate_ids = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.enable_certificate_validation = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.enable_rbd_download     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.endpoint_override       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.insecure                = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.keyfile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.max_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.min_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.num_retries             = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.rbd_ceph_conf           =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.rbd_connect_timeout     = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.rbd_pool                =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.rbd_user                =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.region_name             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.service_name            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.service_type            = image {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.split_loggers           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.status_code_retries     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.timeout                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.verify_glance_signatures = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] glance.version                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] guestfs.debug                  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.config_drive_cdrom      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.config_drive_inject_password = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.enable_remotefx         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.instances_path_share    =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.limit_cpu_features      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.use_multipath_io        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.vswitch_name            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] mks.enabled                    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.manager_interval   = 2400 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.precache_concurrency = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.remove_unused_base_images = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] image_cache.subdirectory_name  = _base {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.api_max_retries         = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.api_retry_interval      = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.auth_section            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.auth_type               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.cafile                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.certfile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.collect_timing          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.conductor_group         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.connect_retries         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.connect_retry_delay     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.endpoint_override       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.insecure                = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.keyfile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.max_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.min_version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.peer_list               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.region_name             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.serial_console_state_timeout = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.service_name            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.service_type            = baremetal {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.split_loggers           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.status_code_retries     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.timeout                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ironic.version                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] key_manager.fixed_key          = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.barbican_api_version  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.barbican_endpoint     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.barbican_endpoint_type = public {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.barbican_region_name  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.cafile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.certfile              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.collect_timing        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.insecure              = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.keyfile               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.number_of_retries     = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.retry_delay           = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.send_service_user_token = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.split_loggers         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.timeout               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.verify_ssl            = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican.verify_ssl_path       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.auth_section = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.auth_type = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.cafile   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.certfile = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.collect_timing = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.insecure = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.keyfile  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.split_loggers = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] barbican_service_user.timeout  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.approle_role_id          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.approle_secret_id        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.cafile                   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.certfile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.collect_timing           = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.insecure                 = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.keyfile                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.kv_mountpoint            = secret {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.kv_path                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.kv_version               = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.namespace                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.root_token_id            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.split_loggers            = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.ssl_ca_crt_file          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.timeout                  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.use_ssl                  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.auth_section          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.auth_type             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.cafile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.certfile              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.collect_timing        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.connect_retries       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.connect_retry_delay   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.endpoint_override     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.insecure              = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.keyfile               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.max_version           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.min_version           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.region_name           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.service_name          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.service_type          = identity {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.split_loggers         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.status_code_retries   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.timeout               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] keystone.version               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.connection_uri         =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_mode               = custom {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: WARNING oslo_config.cfg [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_power_governor_high = performance {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_power_management   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.device_detach_attempts = 8 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.device_detach_timeout  = 20 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.disk_cachemodes        = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.disk_prefix            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.enabled_perf_events    = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.file_backed_memory     = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.gid_maps               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.hw_disk_discard        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.hw_machine_type        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_rbd_pool        = rbd {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_type            = default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.images_volume_group    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.inject_key             = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.inject_partition       = -2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.inject_password        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.iscsi_iface            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.iser_use_multipath     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_downtime = 500 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_inbound_addr = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_scheme  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_timeout_action = abort {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_tunnelled = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: WARNING oslo_config.cfg [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 23:55:15 user nova-compute[75279]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 23:55:15 user nova-compute[75279]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 23:55:15 user nova-compute[75279]: and ``live_migration_inbound_addr`` respectively.
Nov 10 23:55:15 user nova-compute[75279]: ).  Its value may be silently ignored in the future.
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.live_migration_with_native_tls = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.max_queues             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.nfs_mount_options      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_pcie_ports         = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.pmem_namespaces        = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.quobyte_client_cfg     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rbd_secret_uuid        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rbd_user               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rescue_image_id        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rescue_kernel_id       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.rx_queue_size          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.smbfs_mount_options    =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.snapshot_compression   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.snapshot_image_format  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.sparse_logical_volumes = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.swtpm_enabled          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.swtpm_group            = tss {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.swtpm_user             = tss {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.sysinfo_serial         = unique {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.tb_cache_size          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.tx_queue_size          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.uid_maps               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.use_virtio_for_bridges = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.virt_type              = kvm {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.volume_clear           = zero {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.volume_clear_size      = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.volume_use_multipath   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_cache_path   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.auth_section           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.auth_type              = password {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.cafile                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.certfile               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.collect_timing         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.connect_retries        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.connect_retry_delay    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.default_floating_pool  = public {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.endpoint_override      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.extension_sync_interval = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.http_retries           = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.insecure               = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.keyfile                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.max_version            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.min_version            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.ovs_bridge             = br-int {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.physnets               = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.region_name            = RegionOne {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.service_metadata_proxy = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.service_name           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.service_type           = network {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.split_loggers          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.status_code_retries    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.timeout                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] neutron.version                = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] notifications.bdms_in_notifications = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] notifications.default_level    = INFO {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] notifications.notification_format = unversioned {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] notifications.notify_on_state_change = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] pci.alias                      = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] pci.device_spec                = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] pci.report_in_placement        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.auth_section         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.auth_type            = password {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.cafile               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.certfile             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.collect_timing       = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.connect_retries      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.connect_retry_delay  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.default_domain_id    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.default_domain_name  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.domain_id            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.domain_name          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.endpoint_override    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.insecure             = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.keyfile              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.max_version          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.min_version          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.password             = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.project_domain_id    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.project_domain_name  = Default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.project_id           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.project_name         = service {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.region_name          = RegionOne {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.service_name         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.service_type         = placement {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.split_loggers        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.status_code_retries  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.system_scope         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.timeout              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.trust_id             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.user_domain_id       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.user_domain_name     = Default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.user_id              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.username             = placement {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] placement.version              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.cores                    = 20 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.count_usage_from_placement = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.injected_file_content_bytes = 10240 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.injected_file_path_length = 255 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.injected_files           = 5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.instances                = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.key_pairs                = 100 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.metadata_items           = 128 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.ram                      = 51200 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.recheck_quota            = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.server_group_members     = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] quota.server_groups            = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rdp.enabled                    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.image_metadata_prefilter = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.max_attempts         = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.max_placement_results = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] scheduler.workers              = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.host_subset_size = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.isolated_hosts = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.isolated_images = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.pci_in_placement = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.track_instance_changes = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metrics.required               = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metrics.weight_multiplier      = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] metrics.weight_setting         = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.enabled         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.port_range      = 10000:20000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] serial_console.serialproxy_port = 6083 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.auth_section      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.auth_type         = password {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.cafile            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.certfile          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.collect_timing    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.insecure          = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.keyfile           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.send_service_user_token = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.split_loggers     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] service_user.timeout           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.agent_enabled            = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.enabled                  = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.html5proxy_port          = 6082 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.image_compression        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.jpeg_compression         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.playback_compression     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.server_listen            = 127.0.0.1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.streaming_mode           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] spice.zlib_compression         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] upgrade_levels.baseapi         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] upgrade_levels.cert            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] upgrade_levels.compute         = auto {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] upgrade_levels.conductor       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] upgrade_levels.scheduler       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.cafile = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.certfile = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.insecure = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vendordata_dynamic_auth.timeout = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.api_retry_count         = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.ca_file                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.cache_prefix            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.cluster_name            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.connection_pool_size    = 10 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.console_delay_seconds   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.datastore_regex         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.host_ip                 = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.host_password           = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.host_port               = 443 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.host_username           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.insecure                = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.integration_bridge      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.maximum_objects         = 100 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.pbm_default_policy      = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.pbm_enabled             = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.pbm_wsdl_location       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.serial_port_proxy_uri   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.serial_port_service_uri = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.task_poll_interval      = 0.5 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.use_linked_clone        = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.vnc_keymap              = en-us {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.vnc_port                = 5900 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vmware.vnc_port_total          = 10000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.auth_schemes               = ['none'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.enabled                    = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.novncproxy_port            = 6080 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.vencrypt_ca_certs          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.vencrypt_client_cert       = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vnc.vencrypt_client_key        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.disable_rootwrap   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.enable_numa_live_migration = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.libvirt_disable_apic = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.client_socket_timeout     = 900 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.default_pool_size         = 1000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.keep_alive                = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.max_header_line           = 16384 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:15 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.ssl_ca_file               = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.ssl_cert_file             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.ssl_key_file              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.tcp_keepidle              = 600 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] zvm.ca_file                    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] zvm.cloud_connector_url        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] zvm.reachable_timeout          = 300 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.enforce_new_defaults = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.enforce_scope      = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.policy_default_rule = default {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.connection_string     = messaging:// {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.enabled               = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.es_doc_type           = notification {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.es_scroll_size        = 10000 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.es_scroll_time        = 2m {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.filter_error_trace    = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.hmac_keys             = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.sentinel_service_name = mymaster {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.socket_timeout        = 0.1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.trace_requests        = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler.trace_sqlalchemy      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler_jaeger.process_tags   = {} {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler_jaeger.service_name_prefix = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] profiler_otlp.service_name_prefix = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] remote_debug.host              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] remote_debug.port              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_notifications.retry = -1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.auth_section        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.auth_type           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.cafile              = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.certfile            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.collect_timing      = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.connect_retries     = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.connect_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.endpoint_id         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.endpoint_override   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.insecure            = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.keyfile             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.max_version         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.min_version         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.region_name         = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.service_name        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.service_type        = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.split_loggers       = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.status_code_retries = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.status_code_retry_delay = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.timeout             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.valid_interfaces    = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_limit.version             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_reports.file_event_handler = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] oslo_reports.log_dir           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.group  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] vif_plug_ovs_privileged.user   = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.isolate_vif         = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] os_brick.lock_path             = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.capabilities   = [21] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.group          = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.helper_command = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] privsep_osbrick.user           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.group           = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.helper_command  = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] nova_sys_admin.user            = None {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG oslo_service.service [None req-9c6818ea-10f1-4ef8-9b81-b3cab1c45351 None None] ******************************************************************************** {{(pid=75279) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 23:55:16 user nova-compute[75279]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Connecting to libvirt: qemu:///system {{(pid=75279) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7200cdaef0> {{(pid=75279) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 23:55:16 user nova-compute[75279]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 23:55:16 user nova-compute[75279]: WARNING nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7200cdaef0> {{(pid=75279) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Starting native event thread {{(pid=75279) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Starting green dispatch thread {{(pid=75279) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Starting connection event dispatch thread {{(pid=75279) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 23:55:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Connection event '1' reason 'None'
Nov 10 23:55:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 23:55:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.mount [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Initialising _HostMountState generation 0 {{(pid=75279) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host capabilities <capabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <host>
Nov 10 23:55:23 user nova-compute[75279]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 23:55:23 user nova-compute[75279]:     <cpu>
Nov 10 23:55:23 user nova-compute[75279]:       <arch>x86_64</arch>
Nov 10 23:55:23 user nova-compute[75279]:       <model>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <microcode version='1070'/>
Nov 10 23:55:23 user nova-compute[75279]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='osxsave'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='invtsc'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='rsba'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 23:55:23 user nova-compute[75279]:       <pages unit='KiB' size='4'/>
Nov 10 23:55:23 user nova-compute[75279]:       <pages unit='KiB' size='2048'/>
Nov 10 23:55:23 user nova-compute[75279]:     </cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <power_management>
Nov 10 23:55:23 user nova-compute[75279]:       <suspend_mem/>
Nov 10 23:55:23 user nova-compute[75279]:       <suspend_disk/>
Nov 10 23:55:23 user nova-compute[75279]:       <suspend_hybrid/>
Nov 10 23:55:23 user nova-compute[75279]:     </power_management>
Nov 10 23:55:23 user nova-compute[75279]:     <iommu support='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <migration_features>
Nov 10 23:55:23 user nova-compute[75279]:       <live/>
Nov 10 23:55:23 user nova-compute[75279]:       <uri_transports>
Nov 10 23:55:23 user nova-compute[75279]:         <uri_transport>tcp</uri_transport>
Nov 10 23:55:23 user nova-compute[75279]:         <uri_transport>rdma</uri_transport>
Nov 10 23:55:23 user nova-compute[75279]:       </uri_transports>
Nov 10 23:55:23 user nova-compute[75279]:     </migration_features>
Nov 10 23:55:23 user nova-compute[75279]:     <topology>
Nov 10 23:55:23 user nova-compute[75279]:       <cells num='2'>
Nov 10 23:55:23 user nova-compute[75279]:         <cell id='0'>
Nov 10 23:55:23 user nova-compute[75279]:           <memory unit='KiB'>8189224</memory>
Nov 10 23:55:23 user nova-compute[75279]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 10 23:55:23 user nova-compute[75279]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 23:55:23 user nova-compute[75279]:           <distances>
Nov 10 23:55:23 user nova-compute[75279]:             <sibling id='0' value='10'/>
Nov 10 23:55:23 user nova-compute[75279]:             <sibling id='1' value='20'/>
Nov 10 23:55:23 user nova-compute[75279]:           </distances>
Nov 10 23:55:23 user nova-compute[75279]:           <cpus num='6'>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 23:55:23 user nova-compute[75279]:           </cpus>
Nov 10 23:55:23 user nova-compute[75279]:         </cell>
Nov 10 23:55:23 user nova-compute[75279]:         <cell id='1'>
Nov 10 23:55:23 user nova-compute[75279]:           <memory unit='KiB'>8206492</memory>
Nov 10 23:55:23 user nova-compute[75279]:           <pages unit='KiB' size='4'>2051623</pages>
Nov 10 23:55:23 user nova-compute[75279]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 23:55:23 user nova-compute[75279]:           <distances>
Nov 10 23:55:23 user nova-compute[75279]:             <sibling id='0' value='20'/>
Nov 10 23:55:23 user nova-compute[75279]:             <sibling id='1' value='10'/>
Nov 10 23:55:23 user nova-compute[75279]:           </distances>
Nov 10 23:55:23 user nova-compute[75279]:           <cpus num='6'>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 23:55:23 user nova-compute[75279]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 23:55:23 user nova-compute[75279]:           </cpus>
Nov 10 23:55:23 user nova-compute[75279]:         </cell>
Nov 10 23:55:23 user nova-compute[75279]:       </cells>
Nov 10 23:55:23 user nova-compute[75279]:     </topology>
Nov 10 23:55:23 user nova-compute[75279]:     <cache>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 23:55:23 user nova-compute[75279]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 23:55:23 user nova-compute[75279]:     </cache>
Nov 10 23:55:23 user nova-compute[75279]:     <secmodel>
Nov 10 23:55:23 user nova-compute[75279]:       <model>apparmor</model>
Nov 10 23:55:23 user nova-compute[75279]:       <doi>0</doi>
Nov 10 23:55:23 user nova-compute[75279]:     </secmodel>
Nov 10 23:55:23 user nova-compute[75279]:     <secmodel>
Nov 10 23:55:23 user nova-compute[75279]:       <model>dac</model>
Nov 10 23:55:23 user nova-compute[75279]:       <doi>0</doi>
Nov 10 23:55:23 user nova-compute[75279]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 23:55:23 user nova-compute[75279]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 23:55:23 user nova-compute[75279]:     </secmodel>
Nov 10 23:55:23 user nova-compute[75279]:   </host>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='alpha'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>clipper</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='armv6l'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>spitz</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>nuri</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>kzm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>z2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>tosa</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n810</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>terrier</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>midway</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>microbit</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>verdex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>highbank</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>akita</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>connex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>collie</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='armv7l'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>spitz</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>nuri</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>kzm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>z2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>tosa</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n810</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>terrier</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>midway</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>microbit</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>verdex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>highbank</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>akita</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>connex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>collie</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='aarch64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>spitz</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>nuri</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>kzm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>z2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>tosa</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n810</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>n800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>terrier</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>midway</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>microbit</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>verdex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>highbank</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>akita</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>connex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>collie</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <acpi default='on' toggle='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='cris'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='i686'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>isapc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>microvm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='kvm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <pae/>
Nov 10 23:55:23 user nova-compute[75279]:       <nonpae/>
Nov 10 23:55:23 user nova-compute[75279]:       <acpi default='on' toggle='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:       <apic default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='m68k'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>an5206</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>q800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='microblaze'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='microblazeel'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='mips'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>malta</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='mipsel'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>malta</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='mips64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>malta</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>pica61</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>magnum</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='mips64el'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>malta</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>pica61</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>magnum</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='16'>boston</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='ppc'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mac99</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>40p</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>taihu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='ppc64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>taihu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>40p</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mac99</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='ppc64le'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>taihu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>40p</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>mac99</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='riscv32'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='8'>spike</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='8'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='riscv64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='8'>spike</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='8'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='s390x'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='sh4'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>shix</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>r2d</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='sh4eb'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>shix</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>r2d</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='sparc'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>LX</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='sparc64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>niagara</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='x86_64'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>64</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='1'>isapc</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>microvm</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='kvm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <acpi default='on' toggle='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:       <apic default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='xtensa'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>sim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>kc705</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ml605</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx200</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx60</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]:   <guest>
Nov 10 23:55:23 user nova-compute[75279]:     <os_type>hvm</os_type>
Nov 10 23:55:23 user nova-compute[75279]:     <arch name='xtensaeb'>
Nov 10 23:55:23 user nova-compute[75279]:       <wordsize>32</wordsize>
Nov 10 23:55:23 user nova-compute[75279]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='4'>sim</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>kc705</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ml605</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>virt</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx200</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>lx60</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 23:55:23 user nova-compute[75279]:       <domain type='qemu'/>
Nov 10 23:55:23 user nova-compute[75279]:     </arch>
Nov 10 23:55:23 user nova-compute[75279]:     <features>
Nov 10 23:55:23 user nova-compute[75279]:       <cpuselection/>
Nov 10 23:55:23 user nova-compute[75279]:       <deviceboot/>
Nov 10 23:55:23 user nova-compute[75279]:       <disksnapshot default='on' toggle='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     </features>
Nov 10 23:55:23 user nova-compute[75279]:   </guest>
Nov 10 23:55:23 user nova-compute[75279]: </capabilities>
Nov 10 23:55:23 user nova-compute[75279]: 
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-q35-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>i686</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='288'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'/>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='lm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-q35-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>i686</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='288'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'/>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='lm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-i440fx-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>i686</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='255'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'/>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='lm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ide</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-i440fx-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>i686</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='255'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'/>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='lm'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ide</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-q35-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>x86_64</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='288'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>efi</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='invtsc'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='rsba'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-q35-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>x86_64</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='288'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>efi</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='invtsc'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='rsba'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-i440fx-6.2</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>x86_64</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='255'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>efi</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='invtsc'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='rsba'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ide</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 23:55:23 user nova-compute[75279]: <domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 23:55:23 user nova-compute[75279]:   <domain>kvm</domain>
Nov 10 23:55:23 user nova-compute[75279]:   <machine>pc-i440fx-jammy</machine>
Nov 10 23:55:23 user nova-compute[75279]:   <arch>x86_64</arch>
Nov 10 23:55:23 user nova-compute[75279]:   <vcpu max='255'/>
Nov 10 23:55:23 user nova-compute[75279]:   <iothreads supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:   <os supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='firmware'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>efi</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:     <loader supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>rom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pflash</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='readonly'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>yes</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='secure'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>no</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </loader>
Nov 10 23:55:23 user nova-compute[75279]:   </os>
Nov 10 23:55:23 user nova-compute[75279]:   <cpu>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-passthrough' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='hostPassthroughMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='maximum' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='maximumMigratable'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>on</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>off</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='host-model' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <vendor>Intel</vendor>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ss'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='vmx'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pcid'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='hypervisor'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arat'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='umip'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='md-clear'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='invtsc'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibpb'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='ibrs'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-stibp'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='rsba'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='erms'/>
Nov 10 23:55:23 user nova-compute[75279]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:     <mode name='custom' supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>qemu64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>qemu32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>phenom</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>pentium</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>n270</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm64</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>kvm32</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>coreduo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>core2duo</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>athlon</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Westmere</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Snowridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Skylake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>SandyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Penryn</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G5</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G4</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G3</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Opteron_G2</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Opteron_G1</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>IvyBridge</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Icelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Haswell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Rome</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-Milan</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>EPYC</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Dhyana</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cooperlake</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>Conroe</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='no'>Broadwell</model>
Nov 10 23:55:23 user nova-compute[75279]:       <model usable='yes'>486</model>
Nov 10 23:55:23 user nova-compute[75279]:     </mode>
Nov 10 23:55:23 user nova-compute[75279]:   </cpu>
Nov 10 23:55:23 user nova-compute[75279]:   <memoryBacking supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:     <enum name='sourceType'>
Nov 10 23:55:23 user nova-compute[75279]:       <value>file</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>anonymous</value>
Nov 10 23:55:23 user nova-compute[75279]:       <value>memfd</value>
Nov 10 23:55:23 user nova-compute[75279]:     </enum>
Nov 10 23:55:23 user nova-compute[75279]:   </memoryBacking>
Nov 10 23:55:23 user nova-compute[75279]:   <devices>
Nov 10 23:55:23 user nova-compute[75279]:     <disk supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='diskDevice'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>disk</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cdrom</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>floppy</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>lun</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='bus'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ide</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>fdc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sata</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </disk>
Nov 10 23:55:23 user nova-compute[75279]:     <graphics supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='type'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>sdl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vnc</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>spice</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egl-headless</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </graphics>
Nov 10 23:55:23 user nova-compute[75279]:     <video supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='modelType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>cirrus</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>vmvga</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>qxl</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>none</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>bochs</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>ramfb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </video>
Nov 10 23:55:23 user nova-compute[75279]:     <hostdev supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='mode'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>subsystem</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='startupPolicy'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>default</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>mandatory</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>requisite</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>optional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='subsysType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>usb</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>pci</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>scsi</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='capsType'/>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='pciBackend'/>
Nov 10 23:55:23 user nova-compute[75279]:     </hostdev>
Nov 10 23:55:23 user nova-compute[75279]:     <rng supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtio-non-transitional</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>random</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>egd</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>builtin</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </rng>
Nov 10 23:55:23 user nova-compute[75279]:     <filesystem supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='driverType'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>path</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>handle</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>virtiofs</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </filesystem>
Nov 10 23:55:23 user nova-compute[75279]:     <tpm supported='yes'>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='model'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-tis</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>tpm-crb</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:       <enum name='backendModel'>
Nov 10 23:55:23 user nova-compute[75279]:         <value>passthrough</value>
Nov 10 23:55:23 user nova-compute[75279]:         <value>emulator</value>
Nov 10 23:55:23 user nova-compute[75279]:       </enum>
Nov 10 23:55:23 user nova-compute[75279]:     </tpm>
Nov 10 23:55:23 user nova-compute[75279]:   </devices>
Nov 10 23:55:23 user nova-compute[75279]:   <features>
Nov 10 23:55:23 user nova-compute[75279]:     <gic supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:     <vmcoreinfo supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <genid supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backingStoreInput supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <backup supported='yes'/>
Nov 10 23:55:23 user nova-compute[75279]:     <sev supported='no'/>
Nov 10 23:55:23 user nova-compute[75279]:   </features>
Nov 10 23:55:23 user nova-compute[75279]: </domainCapabilities>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75279) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75279) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Checking secure boot support for host arch (x86_64) {{(pid=75279) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Secure Boot support detected
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] cpu compare xml: <cpu match="exact">
Nov 10 23:55:23 user nova-compute[75279]:   <model>Nehalem</model>
Nov 10 23:55:23 user nova-compute[75279]: </cpu>
Nov 10 23:55:23 user nova-compute[75279]:  {{(pid=75279) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.virt.node [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Generated node identity d9002de1-9e35-4b13-abf3-b4c27ac7a991
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.virt.node [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Wrote node identity d9002de1-9e35-4b13-abf3-b4c27ac7a991 to /opt/stack/data/nova/compute_id
Nov 10 23:55:23 user nova-compute[75279]: WARNING nova.compute.manager [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Compute nodes ['d9002de1-9e35-4b13-abf3-b4c27ac7a991'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.compute.manager [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 23:55:23 user nova-compute[75279]: WARNING nova.compute.manager [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 23:55:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:55:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:55:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Hypervisor/Node resource view: name=user free_ram=10953MB free_disk=26.166748046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:55:23 user nova-compute[75279]: WARNING nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] No compute node record for user:d9002de1-9e35-4b13-abf3-b4c27ac7a991: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d9002de1-9e35-4b13-abf3-b4c27ac7a991 could not be found.
Nov 10 23:55:23 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Compute node record created for user:user with uuid: d9002de1-9e35-4b13-abf3-b4c27ac7a991
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:55:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:55:24 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] [req-29b1cce5-c3cc-4510-8052-7c35bd75d726] Created resource provider record via placement API for resource provider with UUID d9002de1-9e35-4b13-abf3-b4c27ac7a991 and name user.
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75279) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 23:55:24 user nova-compute[75279]: INFO nova.virt.libvirt.host [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] kernel doesn't support AMD SEV
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Libvirt baseline CPU <cpu>
Nov 10 23:55:24 user nova-compute[75279]:   <arch>x86_64</arch>
Nov 10 23:55:24 user nova-compute[75279]:   <model>Nehalem</model>
Nov 10 23:55:24 user nova-compute[75279]:   <vendor>Intel</vendor>
Nov 10 23:55:24 user nova-compute[75279]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 23:55:24 user nova-compute[75279]: </cpu>
Nov 10 23:55:24 user nova-compute[75279]:  {{(pid=75279) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Updated inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Updating resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 generation from 0 to 1 during operation: update_inventory {{(pid=75279) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Updating resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 generation from 1 to 2 during operation: update_traits {{(pid=75279) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.service [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Creating RPC server for service compute {{(pid=75279) start /opt/stack/nova/nova/service.py:182}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.service [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] Join ServiceGroup membership for this service compute {{(pid=75279) start /opt/stack/nova/nova/service.py:199}}
Nov 10 23:55:24 user nova-compute[75279]: DEBUG nova.servicegroup.drivers.db [None req-f3cfe710-73ac-4fb8-a23d-d92d2735fa7e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75279) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 23:56:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:56:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:56:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=10398MB free_disk=26.070571899414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:56:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:57:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:57:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:57:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=26.13475799560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:57:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:58:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:58:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=10368MB free_disk=25.887348175048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:58:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:58:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:58:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:58:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:58:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:58:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9587MB free_disk=25.915550231933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance ce47c153-409d-472c-a0bf-032c043aeb06 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.245s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:17 user nova-compute[75279]: INFO nova.compute.claims [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Claim successful on node user
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Creating image(s)
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "/opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "/opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG nova.policy [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcb0668b2de54aa19a660b0995652f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10808be56d234af1b53bf285fcaacc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.part --force-share --output=json" returned: 0 in 0.154s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG nova.virt.images [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] 94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.part /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.part /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.converted" returned: 0 in 0.144s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.523s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:19 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplfn3_l_r/privsep.sock']
Nov 10 23:59:19 user sudo[84513]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplfn3_l_r/privsep.sock
Nov 10 23:59:19 user sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 23:59:20 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Successfully created port: 648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:20 user sudo[84513]: pam_unix(sudo:session): session closed for user root
Nov 10 23:59:20 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Spawned new privsep daemon via rootwrap
Nov 10 23:59:20 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 23:59:20 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 23:59:20 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 23:59:20 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84518
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Skipping network cache update for instance because it is Building. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk 1073741824" returned: 0 in 0.045s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.158s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Cannot resize image /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Ensure instance console log exists: /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Successfully updated port: 648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquired lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-changed-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Refreshing instance network info cache due to event network-changed-648b3236-d5b1-4539-88ba-7407b5cd35f0. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] Acquiring lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updating instance_info_cache with network_info: [{"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Releasing lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Instance network_info: |[{"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] Acquired lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.neutron [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Refreshing network info cache for port 648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Start _get_guest_xml network_info=[{"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:25 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:25 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2011501669',display_name='tempest-DeleteServersTestJSON-server-2011501669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2011501669',id=1,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10808be56d234af1b53bf285fcaacc67',ramdisk_id='',reservation_id='r-330d0347',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-424882729',owner_user_name='tempest-DeleteServersTestJSON-424882729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:18Z,user_data=None,user_id='dcb0668b2de54aa19a660b0995652f8a',uuid=ce47c153-409d-472c-a0bf-032c043aeb06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converting VIF {"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lazy-loading 'pci_devices' on Instance uuid ce47c153-409d-472c-a0bf-032c043aeb06 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:25 user nova-compute[75279]:   <uuid>ce47c153-409d-472c-a0bf-032c043aeb06</uuid>
Nov 10 23:59:25 user nova-compute[75279]:   <name>instance-00000001</name>
Nov 10 23:59:25 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:25 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:25 user nova-compute[75279]:   <metadata>
Nov 10 23:59:25 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:25 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:name>tempest-DeleteServersTestJSON-server-2011501669</nova:name>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:25</nova:creationTime>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:25 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:25 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:user uuid="dcb0668b2de54aa19a660b0995652f8a">tempest-DeleteServersTestJSON-424882729-project-member</nova:user>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:project uuid="10808be56d234af1b53bf285fcaacc67">tempest-DeleteServersTestJSON-424882729</nova:project>
Nov 10 23:59:25 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:25 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:25 user nova-compute[75279]:         <nova:port uuid="648b3236-d5b1-4539-88ba-7407b5cd35f0">
Nov 10 23:59:25 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 23:59:25 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:25 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:25 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:25 user nova-compute[75279]:   </metadata>
Nov 10 23:59:25 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:25 user nova-compute[75279]:     <system>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="serial">ce47c153-409d-472c-a0bf-032c043aeb06</entry>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="uuid">ce47c153-409d-472c-a0bf-032c043aeb06</entry>
Nov 10 23:59:25 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:25 user nova-compute[75279]:     </system>
Nov 10 23:59:25 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:25 user nova-compute[75279]:   <os>
Nov 10 23:59:25 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:25 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:25 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:25 user nova-compute[75279]:   </os>
Nov 10 23:59:25 user nova-compute[75279]:   <features>
Nov 10 23:59:25 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:25 user nova-compute[75279]:     <apic/>
Nov 10 23:59:25 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:25 user nova-compute[75279]:   </features>
Nov 10 23:59:25 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:25 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:25 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:25 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:25 user nova-compute[75279]:   </clock>
Nov 10 23:59:25 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:25 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:25 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:25 user nova-compute[75279]:   </cpu>
Nov 10 23:59:25 user nova-compute[75279]:   <devices>
Nov 10 23:59:25 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:25 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:25 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk"/>
Nov 10 23:59:25 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:25 user nova-compute[75279]:     </disk>
Nov 10 23:59:25 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:25 user nova-compute[75279]:       <mac address="fa:16:3e:27:75:4d"/>
Nov 10 23:59:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:25 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:25 user nova-compute[75279]:       <target dev="tap648b3236-d5"/>
Nov 10 23:59:25 user nova-compute[75279]:     </interface>
Nov 10 23:59:25 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:25 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/console.log" append="off"/>
Nov 10 23:59:25 user nova-compute[75279]:     </serial>
Nov 10 23:59:25 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:25 user nova-compute[75279]:     <video>
Nov 10 23:59:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:25 user nova-compute[75279]:     </video>
Nov 10 23:59:25 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:25 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:25 user nova-compute[75279]:     </rng>
Nov 10 23:59:25 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:25 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:25 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:25 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:25 user nova-compute[75279]:   </devices>
Nov 10 23:59:25 user nova-compute[75279]: </domain>
Nov 10 23:59:25 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2011501669',display_name='tempest-DeleteServersTestJSON-server-2011501669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2011501669',id=1,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10808be56d234af1b53bf285fcaacc67',ramdisk_id='',reservation_id='r-330d0347',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-424882729',owner_user_name='tempest-DeleteServersTestJSON-424882729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:18Z,user_data=None,user_id='dcb0668b2de54aa19a660b0995652f8a',uuid=ce47c153-409d-472c-a0bf-032c043aeb06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converting VIF {"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG os_vif [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Created schema index Interface.name {{(pid=75279) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Created schema index Port.name {{(pid=75279) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Created schema index Bridge.name {{(pid=75279) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [POLLOUT] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c8c64a0-e923-5a6f-984f-0a6160c037f5', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:25 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmply2ji2rq/privsep.sock']
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:25 user sudo[84542]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmply2ji2rq/privsep.sock
Nov 10 23:59:25 user sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:25 user nova-compute[75279]: INFO nova.compute.claims [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Claim successful on node user
Nov 10 23:59:25 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.policy [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3793bc64e645f3b220d49f6c409904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6b384229b48c4b9cf6c8f134967d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Creating image(s)
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk 1073741824" returned: 0 in 0.046s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.network.neutron [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updated VIF entry in instance network info cache for port 648b3236-d5b1-4539-88ba-7407b5cd35f0. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG nova.network.neutron [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updating instance_info_cache with network_info: [{"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5d53ff27-9d5d-4cef-ba89-83867ccb7575 req-006a194d-6840-4678-ad76-7ed0228c6072 service nova] Releasing lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Cannot resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Ensure instance console log exists: /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:27 user sudo[84542]: pam_unix(sudo:session): session closed for user root
Nov 10 23:59:27 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Spawned new privsep daemon via rootwrap
Nov 10 23:59:27 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 23:59:27 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 23:59:27 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 23:59:27 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84568
Nov 10 23:59:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:27 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:27 user nova-compute[75279]: INFO nova.compute.claims [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Claim successful on node user
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap648b3236-d5, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap648b3236-d5, col_values=(('qos', UUID('35339f2c-47c9-4e30-9e19-bc04cb255ec5')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap648b3236-d5, col_values=(('external_ids', {'iface-id': '648b3236-d5b1-4539-88ba-7407b5cd35f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:75:4d', 'vm-uuid': 'ce47c153-409d-472c-a0bf-032c043aeb06'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:28 user nova-compute[75279]: INFO os_vif [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5')
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] No VIF found with MAC fa:16:3e:27:75:4d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Successfully created port: c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Creating image(s)
Nov 10 23:59:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:28 user nova-compute[75279]: DEBUG nova.policy [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '818b35f397a6467f8dec8eb37cef2ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2918206b132a4855a996eac99bbf5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.241s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk 1073741824" returned: 0 in 0.049s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Ensure instance console log exists: /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:30 user nova-compute[75279]: INFO nova.compute.claims [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Claim successful on node user
Nov 10 23:59:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Creating image(s)
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:30 user nova-compute[75279]: DEBUG nova.policy [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '818b35f397a6467f8dec8eb37cef2ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2918206b132a4855a996eac99bbf5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Successfully updated port: c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk 1073741824" returned: 0 in 0.056s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:59:31 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Instance spawned successfully.
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:31 user nova-compute[75279]: INFO nova.compute.claims [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Claim successful on node user
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-changed-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Refreshing instance network info cache due to event network-changed-c2af150b-6845-4dba-95c9-897b82ee2715. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:31 user nova-compute[75279]: INFO nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Took 13.63 seconds to spawn the instance on the hypervisor.
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Cannot resize image /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Ensure instance console log exists: /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:31 user nova-compute[75279]: INFO nova.compute.manager [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Took 14.79 seconds to build instance.
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b169f14-26c3-47dd-a18d-bbe36fabddd1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.019s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:32 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Successfully created port: 491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance network_info: |[{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Refreshing network info cache for port c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start _get_guest_xml network_info=[{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:32 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:32 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'pci_devices' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.policy [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5de431660e34578b7ef8b6b7e0577ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56bb9030efe414aa52c4aa97febfd2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:32 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Creating image(s)
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:32 user nova-compute[75279]:   <uuid>83af4515-8148-461e-9682-9c5917ad61ea</uuid>
Nov 10 23:59:32 user nova-compute[75279]:   <name>instance-00000002</name>
Nov 10 23:59:32 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:32 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:32 user nova-compute[75279]:   <metadata>
Nov 10 23:59:32 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:32 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeTestJSON-server-530644997</nova:name>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:32</nova:creationTime>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:32 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:32 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:user uuid="4d3793bc64e645f3b220d49f6c409904">tempest-AttachVolumeTestJSON-896218417-project-member</nova:user>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:project uuid="1be6b384229b48c4b9cf6c8f134967d1">tempest-AttachVolumeTestJSON-896218417</nova:project>
Nov 10 23:59:32 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:32 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:32 user nova-compute[75279]:         <nova:port uuid="c2af150b-6845-4dba-95c9-897b82ee2715">
Nov 10 23:59:32 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 23:59:32 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:32 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:32 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:32 user nova-compute[75279]:   </metadata>
Nov 10 23:59:32 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:32 user nova-compute[75279]:     <system>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="serial">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="uuid">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 10 23:59:32 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:32 user nova-compute[75279]:     </system>
Nov 10 23:59:32 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:32 user nova-compute[75279]:   <os>
Nov 10 23:59:32 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:32 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:32 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:32 user nova-compute[75279]:   </os>
Nov 10 23:59:32 user nova-compute[75279]:   <features>
Nov 10 23:59:32 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:32 user nova-compute[75279]:     <apic/>
Nov 10 23:59:32 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:32 user nova-compute[75279]:   </features>
Nov 10 23:59:32 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:32 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:32 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:32 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:32 user nova-compute[75279]:   </clock>
Nov 10 23:59:32 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:32 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:32 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:32 user nova-compute[75279]:   </cpu>
Nov 10 23:59:32 user nova-compute[75279]:   <devices>
Nov 10 23:59:32 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:32 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:32 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk"/>
Nov 10 23:59:32 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:32 user nova-compute[75279]:     </disk>
Nov 10 23:59:32 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:32 user nova-compute[75279]:       <mac address="fa:16:3e:9d:b7:6d"/>
Nov 10 23:59:32 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:32 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:32 user nova-compute[75279]:       <target dev="tapc2af150b-68"/>
Nov 10 23:59:32 user nova-compute[75279]:     </interface>
Nov 10 23:59:32 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:32 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/console.log" append="off"/>
Nov 10 23:59:32 user nova-compute[75279]:     </serial>
Nov 10 23:59:32 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:32 user nova-compute[75279]:     <video>
Nov 10 23:59:32 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:32 user nova-compute[75279]:     </video>
Nov 10 23:59:32 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:32 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:32 user nova-compute[75279]:     </rng>
Nov 10 23:59:32 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:32 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:32 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:32 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:32 user nova-compute[75279]:   </devices>
Nov 10 23:59:32 user nova-compute[75279]: </domain>
Nov 10 23:59:32 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG os_vif [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73f7cab1-cf74-59f0-bd96-3d4316552ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2af150b-68, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2af150b-68, col_values=(('qos', UUID('11cbb318-6ed3-4e35-891c-4f06e0a371db')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2af150b-68, col_values=(('external_ids', {'iface-id': 'c2af150b-6845-4dba-95c9-897b82ee2715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b7:6d', 'vm-uuid': '83af4515-8148-461e-9682-9c5917ad61ea'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: INFO os_vif [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No VIF found with MAC fa:16:3e:9d:b7:6d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.280s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Successfully created port: 395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.222s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk 1073741824" returned: 0 in 0.064s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.448s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Cannot resize image /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Ensure instance console log exists: /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updated VIF entry in instance network info cache for port c2af150b-6845-4dba-95c9-897b82ee2715. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5b2d9c4a-9ab1-4567-ab65-48259f5ea45c req-93000f03-d0f4-4daa-a542-649069f779bc service nova] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Successfully updated port: 395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Successfully created port: 534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-changed-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Refreshing instance network info cache due to event network-changed-395f7bdd-9cce-4d32-a364-d02403ccbd89. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Successfully updated port: 491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-changed-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Refreshing instance network info cache due to event network-changed-491fd41c-8c05-4bd0-881d-3e1a7c9beec6. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance network_info: |[{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.neutron [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Refreshing network info cache for port 395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start _get_guest_xml network_info=[{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-407627822',display_name='tempest-ServerRescueNegativeTestJSON-server-407627822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-407627822',id=4,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-ziwtxk2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:31Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=a77456b7-3d4c-40a9-94f7-661efc298e50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:36 user nova-compute[75279]:   <uuid>a77456b7-3d4c-40a9-94f7-661efc298e50</uuid>
Nov 10 23:59:36 user nova-compute[75279]:   <name>instance-00000004</name>
Nov 10 23:59:36 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:36 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:36 user nova-compute[75279]:   <metadata>
Nov 10 23:59:36 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:36 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-407627822</nova:name>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:36</nova:creationTime>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:36 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:36 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 10 23:59:36 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:36 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:36 user nova-compute[75279]:         <nova:port uuid="395f7bdd-9cce-4d32-a364-d02403ccbd89">
Nov 10 23:59:36 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 23:59:36 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:36 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:36 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:36 user nova-compute[75279]:   </metadata>
Nov 10 23:59:36 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:36 user nova-compute[75279]:     <system>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="serial">a77456b7-3d4c-40a9-94f7-661efc298e50</entry>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="uuid">a77456b7-3d4c-40a9-94f7-661efc298e50</entry>
Nov 10 23:59:36 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:36 user nova-compute[75279]:     </system>
Nov 10 23:59:36 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:36 user nova-compute[75279]:   <os>
Nov 10 23:59:36 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:36 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:36 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:36 user nova-compute[75279]:   </os>
Nov 10 23:59:36 user nova-compute[75279]:   <features>
Nov 10 23:59:36 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:36 user nova-compute[75279]:     <apic/>
Nov 10 23:59:36 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:36 user nova-compute[75279]:   </features>
Nov 10 23:59:36 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:36 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:36 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:36 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:36 user nova-compute[75279]:   </clock>
Nov 10 23:59:36 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:36 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:36 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:36 user nova-compute[75279]:   </cpu>
Nov 10 23:59:36 user nova-compute[75279]:   <devices>
Nov 10 23:59:36 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:36 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:36 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk"/>
Nov 10 23:59:36 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:36 user nova-compute[75279]:     </disk>
Nov 10 23:59:36 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:36 user nova-compute[75279]:       <mac address="fa:16:3e:02:ee:8d"/>
Nov 10 23:59:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:36 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:36 user nova-compute[75279]:       <target dev="tap395f7bdd-9c"/>
Nov 10 23:59:36 user nova-compute[75279]:     </interface>
Nov 10 23:59:36 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:36 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/console.log" append="off"/>
Nov 10 23:59:36 user nova-compute[75279]:     </serial>
Nov 10 23:59:36 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:36 user nova-compute[75279]:     <video>
Nov 10 23:59:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:36 user nova-compute[75279]:     </video>
Nov 10 23:59:36 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:36 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:36 user nova-compute[75279]:     </rng>
Nov 10 23:59:36 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:36 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:36 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:36 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:36 user nova-compute[75279]:   </devices>
Nov 10 23:59:36 user nova-compute[75279]: </domain>
Nov 10 23:59:36 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-407627822',display_name='tempest-ServerRescueNegativeTestJSON-server-407627822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-407627822',id=4,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-ziwtxk2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:31Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=a77456b7-3d4c-40a9-94f7-661efc298e50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG os_vif [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62191dcf-0551-5b41-a0a8-a90358b08b50', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap395f7bdd-9c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap395f7bdd-9c, col_values=(('qos', UUID('a0ce4d3f-7f42-4316-9e92-41e25738b27b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap395f7bdd-9c, col_values=(('external_ids', {'iface-id': '395f7bdd-9cce-4d32-a364-d02403ccbd89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ee:8d', 'vm-uuid': 'a77456b7-3d4c-40a9-94f7-661efc298e50'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:36 user nova-compute[75279]: INFO os_vif [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c')
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:02:ee:8d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Successfully updated port: 534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance spawned successfully.
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:37 user nova-compute[75279]: INFO nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Took 11.15 seconds to spawn the instance on the hypervisor.
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing instance network info cache due to event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:37 user nova-compute[75279]: INFO nova.compute.manager [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Took 12.11 seconds to build instance.
Nov 10 23:59:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c8d8aa63-e071-4b67-8313-cf97756e4520 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.365s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updated VIF entry in instance network info cache for port 395f7bdd-9cce-4d32-a364-d02403ccbd89. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cd3ef084-864f-40f3-bec6-c1f6975619fd req-a019a682-0302-4881-bfaf-0ad909309dd0 service nova] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance network_info: |[{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Refreshing network info cache for port 491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start _get_guest_xml network_info=[{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143249965',display_name='tempest-ServerRescueNegativeTestJSON-server-1143249965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143249965',id=3,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-xxwya5w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:29Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=2bb536aa-c923-4be4-a399-e5f1270bf463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.objects.instance [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:38 user nova-compute[75279]:   <uuid>2bb536aa-c923-4be4-a399-e5f1270bf463</uuid>
Nov 10 23:59:38 user nova-compute[75279]:   <name>instance-00000003</name>
Nov 10 23:59:38 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:38 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:38 user nova-compute[75279]:   <metadata>
Nov 10 23:59:38 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:38 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1143249965</nova:name>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:38</nova:creationTime>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:38 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:port uuid="491fd41c-8c05-4bd0-881d-3e1a7c9beec6">
Nov 10 23:59:38 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 23:59:38 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:38 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:38 user nova-compute[75279]:   </metadata>
Nov 10 23:59:38 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:38 user nova-compute[75279]:     <system>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="serial">2bb536aa-c923-4be4-a399-e5f1270bf463</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="uuid">2bb536aa-c923-4be4-a399-e5f1270bf463</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:38 user nova-compute[75279]:     </system>
Nov 10 23:59:38 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:38 user nova-compute[75279]:   <os>
Nov 10 23:59:38 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:38 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:38 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:38 user nova-compute[75279]:   </os>
Nov 10 23:59:38 user nova-compute[75279]:   <features>
Nov 10 23:59:38 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:38 user nova-compute[75279]:     <apic/>
Nov 10 23:59:38 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:38 user nova-compute[75279]:   </features>
Nov 10 23:59:38 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:38 user nova-compute[75279]:   </clock>
Nov 10 23:59:38 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:38 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:38 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:38 user nova-compute[75279]:   </cpu>
Nov 10 23:59:38 user nova-compute[75279]:   <devices>
Nov 10 23:59:38 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:38 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:38 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk"/>
Nov 10 23:59:38 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:     </disk>
Nov 10 23:59:38 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:38 user nova-compute[75279]:       <mac address="fa:16:3e:76:b7:97"/>
Nov 10 23:59:38 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:38 user nova-compute[75279]:       <target dev="tap491fd41c-8c"/>
Nov 10 23:59:38 user nova-compute[75279]:     </interface>
Nov 10 23:59:38 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:38 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/console.log" append="off"/>
Nov 10 23:59:38 user nova-compute[75279]:     </serial>
Nov 10 23:59:38 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:38 user nova-compute[75279]:     <video>
Nov 10 23:59:38 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:     </video>
Nov 10 23:59:38 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:38 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:38 user nova-compute[75279]:     </rng>
Nov 10 23:59:38 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:38 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:38 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:38 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:38 user nova-compute[75279]:   </devices>
Nov 10 23:59:38 user nova-compute[75279]: </domain>
Nov 10 23:59:38 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143249965',display_name='tempest-ServerRescueNegativeTestJSON-server-1143249965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143249965',id=3,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-xxwya5w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:29Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=2bb536aa-c923-4be4-a399-e5f1270bf463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG os_vif [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2513efc-13e5-5b27-878a-c64bb7cb5f31', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491fd41c-8c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap491fd41c-8c, col_values=(('qos', UUID('36dffbbb-c3c2-4b6a-af03-15bcc5280853')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap491fd41c-8c, col_values=(('external_ids', {'iface-id': '491fd41c-8c05-4bd0-881d-3e1a7c9beec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b7:97', 'vm-uuid': '2bb536aa-c923-4be4-a399-e5f1270bf463'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: INFO os_vif [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c')
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:76:b7:97, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Instance network_info: |[{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Start _get_guest_xml network_info=[{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1401811801',display_name='tempest-ServerActionsTestOtherA-server-1401811801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1401811801',id=5,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-vaym1mfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=9e720d48-0c0f-4fe6-b778-e5568e97eabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.objects.instance [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e720d48-0c0f-4fe6-b778-e5568e97eabf {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:38 user nova-compute[75279]:   <uuid>9e720d48-0c0f-4fe6-b778-e5568e97eabf</uuid>
Nov 10 23:59:38 user nova-compute[75279]:   <name>instance-00000005</name>
Nov 10 23:59:38 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:38 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:38 user nova-compute[75279]:   <metadata>
Nov 10 23:59:38 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:38 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherA-server-1401811801</nova:name>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:38</nova:creationTime>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:38 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:user uuid="f5de431660e34578b7ef8b6b7e0577ab">tempest-ServerActionsTestOtherA-191498200-project-member</nova:user>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:project uuid="e56bb9030efe414aa52c4aa97febfd2e">tempest-ServerActionsTestOtherA-191498200</nova:project>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:38 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:38 user nova-compute[75279]:         <nova:port uuid="534db674-6cbc-4e0b-b7fe-25c317603b29">
Nov 10 23:59:38 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 23:59:38 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:38 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:38 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:38 user nova-compute[75279]:   </metadata>
Nov 10 23:59:38 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:38 user nova-compute[75279]:     <system>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="serial">9e720d48-0c0f-4fe6-b778-e5568e97eabf</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="uuid">9e720d48-0c0f-4fe6-b778-e5568e97eabf</entry>
Nov 10 23:59:38 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:38 user nova-compute[75279]:     </system>
Nov 10 23:59:38 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:38 user nova-compute[75279]:   <os>
Nov 10 23:59:38 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:38 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:38 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:38 user nova-compute[75279]:   </os>
Nov 10 23:59:38 user nova-compute[75279]:   <features>
Nov 10 23:59:38 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:38 user nova-compute[75279]:     <apic/>
Nov 10 23:59:38 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:38 user nova-compute[75279]:   </features>
Nov 10 23:59:38 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:38 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:38 user nova-compute[75279]:   </clock>
Nov 10 23:59:38 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:38 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:38 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:38 user nova-compute[75279]:   </cpu>
Nov 10 23:59:38 user nova-compute[75279]:   <devices>
Nov 10 23:59:38 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:38 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:38 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk"/>
Nov 10 23:59:38 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:     </disk>
Nov 10 23:59:38 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:38 user nova-compute[75279]:       <mac address="fa:16:3e:66:c6:13"/>
Nov 10 23:59:38 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:38 user nova-compute[75279]:       <target dev="tap534db674-6c"/>
Nov 10 23:59:38 user nova-compute[75279]:     </interface>
Nov 10 23:59:38 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:38 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/console.log" append="off"/>
Nov 10 23:59:38 user nova-compute[75279]:     </serial>
Nov 10 23:59:38 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:38 user nova-compute[75279]:     <video>
Nov 10 23:59:38 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:38 user nova-compute[75279]:     </video>
Nov 10 23:59:38 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:38 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:38 user nova-compute[75279]:     </rng>
Nov 10 23:59:38 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:38 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:38 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:38 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:38 user nova-compute[75279]:   </devices>
Nov 10 23:59:38 user nova-compute[75279]: </domain>
Nov 10 23:59:38 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1401811801',display_name='tempest-ServerActionsTestOtherA-server-1401811801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1401811801',id=5,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-vaym1mfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=9e720d48-0c0f-4fe6-b778-e5568e97eabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG os_vif [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6919fea6-13fb-5647-823a-ed6c0f44ffcd', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap534db674-6c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap534db674-6c, col_values=(('qos', UUID('7e8dfee4-02e8-4511-8910-edfabc56a52b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap534db674-6c, col_values=(('external_ids', {'iface-id': '534db674-6cbc-4e0b-b7fe-25c317603b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:c6:13', 'vm-uuid': '9e720d48-0c0f-4fe6-b778-e5568e97eabf'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: INFO os_vif [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c')
Nov 10 23:59:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:66:c6:13, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated VIF entry in instance network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-20625940-5aad-4bf2-9298-45beced53dea req-06547635-719d-4aff-9c6b-dd3ab0288381 service nova] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updated VIF entry in instance network info cache for port 491fd41c-8c05-4bd0-881d-3e1a7c9beec6. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4862bd75-d4b1-4c09-8415-cbd353b0e33d req-04388660-a92c-400a-9c0e-f7faf971cc75 service nova] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] No waiting events found dispatching network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:43 user nova-compute[75279]: WARNING nova.compute.manager [req-d6ce7d5b-f750-4b16-831b-339489be067c req-cb4b4d8e-6af7-4664-9c6b-918fa1117f7d service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received unexpected event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 for instance with vm_state active and task_state None.
Nov 10 23:59:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:45 user nova-compute[75279]: WARNING nova.compute.manager [req-25be31f0-5b9e-4bae-a6a9-025a3f443930 req-5be440b9-836b-4252-9c43-de182e4df54f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state active and task_state None.
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] No waiting events found dispatching network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:45 user nova-compute[75279]: WARNING nova.compute.manager [req-c954acc4-61b8-49d9-9cd1-72eb9dda8ac7 req-4db9fa39-e3d0-4ae6-8828-c8e84638a0fc service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received unexpected event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 for instance with vm_state active and task_state None.
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:59:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance spawned successfully.
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:45 user nova-compute[75279]: INFO nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Took 15.03 seconds to spawn the instance on the hypervisor.
Nov 10 23:59:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.compute.manager [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Took 16.07 seconds to build instance.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7cde7e8f-1209-4548-82a1-cc7d6e3fef28 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.235s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Instance spawned successfully.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance spawned successfully.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Took 14.32 seconds to spawn the instance on the hypervisor.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Took 17.92 seconds to spawn the instance on the hypervisor.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.compute.manager [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Took 15.45 seconds to build instance.
Nov 10 23:59:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7ff0ad1b-3695-4cac-88b9-d7a309446a1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.617s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:46 user nova-compute[75279]: INFO nova.compute.manager [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Took 19.09 seconds to build instance.
Nov 10 23:59:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-20931a1a-4e17-48cb-a9a0-b203029bb0be tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.281s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:47 user nova-compute[75279]: WARNING nova.compute.manager [req-aeeb2ef7-17c9-4416-9f5d-2348c7995490 req-2d7305ba-8c9b-40f8-91b0-39f4ba9c25cb service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state active and task_state None.
Nov 10 23:59:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:50 user nova-compute[75279]: WARNING nova.compute.manager [req-58db0442-315a-4a97-a2c9-b0773b9a5c94 req-4762051c-95d7-430e-b2ac-ccc1a2ee14b5 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state None.
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:50 user nova-compute[75279]: INFO nova.compute.claims [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Claim successful on node user
Nov 10 23:59:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.030s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:59:51 user nova-compute[75279]: INFO nova.compute.claims [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Claim successful on node user
Nov 10 23:59:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:51 user nova-compute[75279]: DEBUG nova.policy [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26cb1b891501491194583c396832cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b05d4a3c04e46bc65c6604034f8d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Creating image(s)
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:52 user nova-compute[75279]: WARNING nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state None.
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] No waiting events found dispatching network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:52 user nova-compute[75279]: WARNING nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received unexpected event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 for instance with vm_state active and task_state None.
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] No waiting events found dispatching network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:52 user nova-compute[75279]: WARNING nova.compute.manager [req-75314bfc-1f3d-4cbc-9d72-522615d8b626 req-27d48805-0ca1-40ba-b1d5-9781e3c2c590 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received unexpected event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 for instance with vm_state active and task_state None.
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:59:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.part --force-share --output=json" returned: 0 in 0.237s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.virt.images [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] 97258f44-00c0-4d0b-b502-2745517503ca was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.part /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.434s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:59:53 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.part /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.converted" returned: 0 in 0.368s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.policy [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b84093a1d3747dab7267e4dd4a2d637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b710cbbc6b4c30b39641d41de04c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:59:53 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Creating image(s)
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "/opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "/opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "/opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade.converted --force-share --output=json" returned: 0 in 0.396s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.723s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Successfully created port: 5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.270s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json" returned: 0 in 0.361s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.393s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk 1073741824" returned: 0 in 0.108s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.515s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:54 user nova-compute[75279]: WARNING nova.compute.manager [req-a6b063d9-9c29-4844-a8ef-07bf89654150 req-bdb28508-a710-4b19-85e3-2684896596f4 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state None.
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json" returned: 0 in 0.365s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade,backing_fmt=raw /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade,backing_fmt=raw /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk 1073741824" returned: 0 in 0.077s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "9c9790cc4876a53a65ec6679c25a2f4599c9eade" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.450s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Successfully updated port: 5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquired lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-changed-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Refreshing instance network info cache due to event network-changed-5f1b14f8-ba61-4f27-af6c-04d430689e64. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] Acquiring lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.390s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Successfully created port: 37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Cannot resize image /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Ensure instance console log exists: /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Cannot resize image /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Ensure instance console log exists: /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updating instance_info_cache with network_info: [{"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Releasing lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Instance network_info: |[{"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] Acquired lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Refreshing network info cache for port 5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Start _get_guest_xml network_info=[{"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:59:42Z,direct_url=<?>,disk_format='qcow2',id=97258f44-00c0-4d0b-b502-2745517503ca,min_disk=0,min_ram=0,name='',owner='40f0a0a39e214d76b7324458c37c8735',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:59:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '97258f44-00c0-4d0b-b502-2745517503ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:59:42Z,direct_url=<?>,disk_format='qcow2',id=97258f44-00c0-4d0b-b502-2745517503ca,min_disk=0,min_ram=0,name='',owner='40f0a0a39e214d76b7324458c37c8735',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:59:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T23:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-665151641',display_name='tempest-AttachSCSIVolumeTestJSON-server-665151641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-665151641',id=6,image_ref='97258f44-00c0-4d0b-b502-2745517503ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODRH7ugzyRXq2bNIADVgKKI0IBvSLwnBrYJOYRymr9qa7ZWJfdOo6CExySY7CO8knqoovBjiEJVsREAqsTt2HJSkj183nbxiPbEMT7jjv+5sbNb4Zr6jKxoiWFFmUduGQ==',key_name='tempest-keypair-2026312299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b05d4a3c04e46bc65c6604034f8d8',ramdisk_id='',reservation_id='r-3zwl48fq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='97258f44-00c0-4d0b-b502-2745517503ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1367875678',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1367875678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26cb1b891501491194583c396832cf3b',uuid=b068deff-cc78-494c-a78a-3ecbd08af62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converting VIF {"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lazy-loading 'pci_devices' on Instance uuid b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:55 user nova-compute[75279]:   <uuid>b068deff-cc78-494c-a78a-3ecbd08af62f</uuid>
Nov 10 23:59:55 user nova-compute[75279]:   <name>instance-00000006</name>
Nov 10 23:59:55 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:55 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:55 user nova-compute[75279]:   <metadata>
Nov 10 23:59:55 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:55 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-665151641</nova:name>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:55</nova:creationTime>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:55 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:55 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:user uuid="26cb1b891501491194583c396832cf3b">tempest-AttachSCSIVolumeTestJSON-1367875678-project-member</nova:user>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:project uuid="db2b05d4a3c04e46bc65c6604034f8d8">tempest-AttachSCSIVolumeTestJSON-1367875678</nova:project>
Nov 10 23:59:55 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:root type="image" uuid="97258f44-00c0-4d0b-b502-2745517503ca"/>
Nov 10 23:59:55 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:55 user nova-compute[75279]:         <nova:port uuid="5f1b14f8-ba61-4f27-af6c-04d430689e64">
Nov 10 23:59:55 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 23:59:55 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:55 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:55 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:55 user nova-compute[75279]:   </metadata>
Nov 10 23:59:55 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:55 user nova-compute[75279]:     <system>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="serial">b068deff-cc78-494c-a78a-3ecbd08af62f</entry>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="uuid">b068deff-cc78-494c-a78a-3ecbd08af62f</entry>
Nov 10 23:59:55 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:55 user nova-compute[75279]:     </system>
Nov 10 23:59:55 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:55 user nova-compute[75279]:   <os>
Nov 10 23:59:55 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:55 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:55 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:55 user nova-compute[75279]:   </os>
Nov 10 23:59:55 user nova-compute[75279]:   <features>
Nov 10 23:59:55 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:55 user nova-compute[75279]:     <apic/>
Nov 10 23:59:55 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:55 user nova-compute[75279]:   </features>
Nov 10 23:59:55 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:55 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:55 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:55 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:55 user nova-compute[75279]:   </clock>
Nov 10 23:59:55 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:55 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:55 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:55 user nova-compute[75279]:   </cpu>
Nov 10 23:59:55 user nova-compute[75279]:   <devices>
Nov 10 23:59:55 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:55 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:55 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk"/>
Nov 10 23:59:55 user nova-compute[75279]:       <target dev="sda" bus="scsi"/>
Nov 10 23:59:55 user nova-compute[75279]:       <address type="drive" controller="0" unit="0"/>
Nov 10 23:59:55 user nova-compute[75279]:     </disk>
Nov 10 23:59:55 user nova-compute[75279]:     <disk type="file" device="cdrom">
Nov 10 23:59:55 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 23:59:55 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.config"/>
Nov 10 23:59:55 user nova-compute[75279]:       <target dev="sdb" bus="scsi"/>
Nov 10 23:59:55 user nova-compute[75279]:       <address type="drive" controller="0" unit="1"/>
Nov 10 23:59:55 user nova-compute[75279]:     </disk>
Nov 10 23:59:55 user nova-compute[75279]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 23:59:55 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:55 user nova-compute[75279]:       <mac address="fa:16:3e:25:c5:f0"/>
Nov 10 23:59:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:55 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:55 user nova-compute[75279]:       <target dev="tap5f1b14f8-ba"/>
Nov 10 23:59:55 user nova-compute[75279]:     </interface>
Nov 10 23:59:55 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:55 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/console.log" append="off"/>
Nov 10 23:59:55 user nova-compute[75279]:     </serial>
Nov 10 23:59:55 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:55 user nova-compute[75279]:     <video>
Nov 10 23:59:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:55 user nova-compute[75279]:     </video>
Nov 10 23:59:55 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:55 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:55 user nova-compute[75279]:     </rng>
Nov 10 23:59:55 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:55 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:55 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:55 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:55 user nova-compute[75279]:   </devices>
Nov 10 23:59:55 user nova-compute[75279]: </domain>
Nov 10 23:59:55 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T23:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-665151641',display_name='tempest-AttachSCSIVolumeTestJSON-server-665151641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-665151641',id=6,image_ref='97258f44-00c0-4d0b-b502-2745517503ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODRH7ugzyRXq2bNIADVgKKI0IBvSLwnBrYJOYRymr9qa7ZWJfdOo6CExySY7CO8knqoovBjiEJVsREAqsTt2HJSkj183nbxiPbEMT7jjv+5sbNb4Zr6jKxoiWFFmUduGQ==',key_name='tempest-keypair-2026312299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b05d4a3c04e46bc65c6604034f8d8',ramdisk_id='',reservation_id='r-3zwl48fq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='97258f44-00c0-4d0b-b502-2745517503ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1367875678',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1367875678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26cb1b891501491194583c396832cf3b',uuid=b068deff-cc78-494c-a78a-3ecbd08af62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converting VIF {"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG os_vif [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caeedc40-dd7c-50d8-8d4d-6d7af2da3c41', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f1b14f8-ba, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f1b14f8-ba, col_values=(('qos', UUID('c2307e27-003c-4d2b-9c15-c4f769c3aebb')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f1b14f8-ba, col_values=(('external_ids', {'iface-id': '5f1b14f8-ba61-4f27-af6c-04d430689e64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:c5:f0', 'vm-uuid': 'b068deff-cc78-494c-a78a-3ecbd08af62f'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:55 user nova-compute[75279]: INFO os_vif [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba')
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No BDM found with device name sda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No VIF found with MAC fa:16:3e:25:c5:f0, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Using config drive
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Successfully updated port: 37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquired lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:59:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Creating config drive at /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.config
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb1txrrvc {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb1txrrvc" returned: 0 in 0.061s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updated VIF entry in instance network info cache for port 5f1b14f8-ba61-4f27-af6c-04d430689e64. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updating instance_info_cache with network_info: [{"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4a20fd0-2dce-4812-b563-26f5090c7041 req-ce69dcd7-62fa-4624-a325-ab4796a0769b service nova] Releasing lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.neutron [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating instance_info_cache with network_info: [{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Releasing lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Instance network_info: |[{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Start _get_guest_xml network_info=[{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:59:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-553116128',display_name='tempest-VolumesAdminNegativeTest-server-553116128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-553116128',id=7,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC2GQKy2hfd476KX4pLncknJnBj6rZJhg/MvMZdhtU4OXwZXdgxikePRARNwyqOwaBDmNjPOT+0/n0F/rm1pq3c7W8nWCeqxUAugUeoqhoLVGgRO9+4Lf2ki0JX/GiPwA==',key_name='tempest-keypair-1410117559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-mgm4a005',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=853efb46-0620-4ed9-8c5e-f3afd8ec9db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.objects.instance [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'pci_devices' on Instance uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:59:56 user nova-compute[75279]:   <uuid>853efb46-0620-4ed9-8c5e-f3afd8ec9db7</uuid>
Nov 10 23:59:56 user nova-compute[75279]:   <name>instance-00000007</name>
Nov 10 23:59:56 user nova-compute[75279]:   <memory>524288</memory>
Nov 10 23:59:56 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 10 23:59:56 user nova-compute[75279]:   <metadata>
Nov 10 23:59:56 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:59:56 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:name>tempest-VolumesAdminNegativeTest-server-553116128</nova:name>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:creationTime>2023-11-10 23:59:56</nova:creationTime>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 10 23:59:56 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:59:56 user nova-compute[75279]:       </nova:flavor>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:owner>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:user uuid="3b84093a1d3747dab7267e4dd4a2d637">tempest-VolumesAdminNegativeTest-2020423556-project-member</nova:user>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:project uuid="85b710cbbc6b4c30b39641d41de04c9b">tempest-VolumesAdminNegativeTest-2020423556</nova:project>
Nov 10 23:59:56 user nova-compute[75279]:       </nova:owner>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 10 23:59:56 user nova-compute[75279]:       <nova:ports>
Nov 10 23:59:56 user nova-compute[75279]:         <nova:port uuid="37aa5ad9-060d-488b-9142-2e87dd6f6451">
Nov 10 23:59:56 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 23:59:56 user nova-compute[75279]:         </nova:port>
Nov 10 23:59:56 user nova-compute[75279]:       </nova:ports>
Nov 10 23:59:56 user nova-compute[75279]:     </nova:instance>
Nov 10 23:59:56 user nova-compute[75279]:   </metadata>
Nov 10 23:59:56 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 10 23:59:56 user nova-compute[75279]:     <system>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="serial">853efb46-0620-4ed9-8c5e-f3afd8ec9db7</entry>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="uuid">853efb46-0620-4ed9-8c5e-f3afd8ec9db7</entry>
Nov 10 23:59:56 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:59:56 user nova-compute[75279]:     </system>
Nov 10 23:59:56 user nova-compute[75279]:   </sysinfo>
Nov 10 23:59:56 user nova-compute[75279]:   <os>
Nov 10 23:59:56 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:59:56 user nova-compute[75279]:     <boot dev="hd"/>
Nov 10 23:59:56 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 10 23:59:56 user nova-compute[75279]:   </os>
Nov 10 23:59:56 user nova-compute[75279]:   <features>
Nov 10 23:59:56 user nova-compute[75279]:     <acpi/>
Nov 10 23:59:56 user nova-compute[75279]:     <apic/>
Nov 10 23:59:56 user nova-compute[75279]:     <vmcoreinfo/>
Nov 10 23:59:56 user nova-compute[75279]:   </features>
Nov 10 23:59:56 user nova-compute[75279]:   <clock offset="utc">
Nov 10 23:59:56 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:59:56 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:59:56 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 10 23:59:56 user nova-compute[75279]:   </clock>
Nov 10 23:59:56 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 10 23:59:56 user nova-compute[75279]:     <model>Nehalem</model>
Nov 10 23:59:56 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:59:56 user nova-compute[75279]:   </cpu>
Nov 10 23:59:56 user nova-compute[75279]:   <devices>
Nov 10 23:59:56 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 10 23:59:56 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:59:56 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk"/>
Nov 10 23:59:56 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 10 23:59:56 user nova-compute[75279]:     </disk>
Nov 10 23:59:56 user nova-compute[75279]:     <interface type="ethernet">
Nov 10 23:59:56 user nova-compute[75279]:       <mac address="fa:16:3e:8f:15:c7"/>
Nov 10 23:59:56 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:56 user nova-compute[75279]:       <mtu size="1442"/>
Nov 10 23:59:56 user nova-compute[75279]:       <target dev="tap37aa5ad9-06"/>
Nov 10 23:59:56 user nova-compute[75279]:     </interface>
Nov 10 23:59:56 user nova-compute[75279]:     <serial type="pty">
Nov 10 23:59:56 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/console.log" append="off"/>
Nov 10 23:59:56 user nova-compute[75279]:     </serial>
Nov 10 23:59:56 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:59:56 user nova-compute[75279]:     <video>
Nov 10 23:59:56 user nova-compute[75279]:       <model type="virtio"/>
Nov 10 23:59:56 user nova-compute[75279]:     </video>
Nov 10 23:59:56 user nova-compute[75279]:     <rng model="virtio">
Nov 10 23:59:56 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:59:56 user nova-compute[75279]:     </rng>
Nov 10 23:59:56 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:59:56 user nova-compute[75279]:     <memballoon model="virtio">
Nov 10 23:59:56 user nova-compute[75279]:       <stats period="10"/>
Nov 10 23:59:56 user nova-compute[75279]:     </memballoon>
Nov 10 23:59:56 user nova-compute[75279]:   </devices>
Nov 10 23:59:56 user nova-compute[75279]: </domain>
Nov 10 23:59:56 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-553116128',display_name='tempest-VolumesAdminNegativeTest-server-553116128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-553116128',id=7,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC2GQKy2hfd476KX4pLncknJnBj6rZJhg/MvMZdhtU4OXwZXdgxikePRARNwyqOwaBDmNjPOT+0/n0F/rm1pq3c7W8nWCeqxUAugUeoqhoLVGgRO9+4Lf2ki0JX/GiPwA==',key_name='tempest-keypair-1410117559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-mgm4a005',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=853efb46-0620-4ed9-8c5e-f3afd8ec9db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG os_vif [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a26ed1b1-728d-551c-8415-4a31e3ea182b', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37aa5ad9-06, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37aa5ad9-06, col_values=(('qos', UUID('1964dabc-5bdc-4438-a97a-90a51b097c7b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37aa5ad9-06, col_values=(('external_ids', {'iface-id': '37aa5ad9-060d-488b-9142-2e87dd6f6451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:15:c7', 'vm-uuid': '853efb46-0620-4ed9-8c5e-f3afd8ec9db7'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:56 user nova-compute[75279]: INFO os_vif [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06')
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:56 user nova-compute[75279]: WARNING nova.compute.manager [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state None.
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-changed-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Refreshing instance network info cache due to event network-changed-37aa5ad9-060d-488b-9142-2e87dd6f6451. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Acquiring lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Acquired lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Refreshing network info cache for port 37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:59:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No VIF found with MAC fa:16:3e:8f:15:c7, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:59:57 user nova-compute[75279]: DEBUG nova.network.neutron [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updated VIF entry in instance network info cache for port 37aa5ad9-060d-488b-9142-2e87dd6f6451. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:59:57 user nova-compute[75279]: DEBUG nova.network.neutron [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating instance_info_cache with network_info: [{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:59:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95f460e4-26e3-42b8-a518-10f0b6f7ea70 req-5cf3704b-fe60-430d-bfea-23832632935e service nova] Releasing lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:59:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:59:59 user nova-compute[75279]: WARNING nova.compute.manager [req-8f6bc799-fcc7-4b88-9927-cf0072e4fe2c req-e1aba2a9-c528-4059-8269-248802403157 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state building and task_state spawning.
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:59:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:00:01 user nova-compute[75279]: INFO nova.compute.claims [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Claim successful on node user
Nov 11 00:00:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:01 user nova-compute[75279]: WARNING nova.compute.manager [req-428477a8-4272-48ce-983b-302f370b991c req-deab7cb0-afac-4176-bd80-50c9b4540a3d service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state building and task_state spawning.
Nov 11 00:00:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.policy [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '570c1cf2722e475d9d8f9878111d2e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf3c986433242a78b50d0ea6ce06200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Creating image(s)
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "/opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "/opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.237s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Instance spawned successfully.
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Instance spawned successfully.
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Took 10.74 seconds to spawn the instance on the hypervisor.
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:00:02 user nova-compute[75279]: INFO nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Took 9.17 seconds to spawn the instance on the hypervisor.
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk 1073741824" returned: 0 in 0.087s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Successfully created port: e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:00:03 user nova-compute[75279]: INFO nova.compute.manager [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Took 11.35 seconds to build instance.
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.236s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82c82c1a-9973-4eb2-99b1-c3e575ae79fe tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.631s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:03 user nova-compute[75279]: INFO nova.compute.manager [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Took 12.66 seconds to build instance.
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4f49d010-b73f-47b9-ad94-c896a0b6998a tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.912s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Cannot resize image /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Ensure instance console log exists: /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Successfully updated port: e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquired lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-changed-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Refreshing instance network info cache due to event network-changed-e05beeaa-cf6b-4c10-b339-9447bae8fde8. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] Acquiring lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating instance_info_cache with network_info: [{"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Releasing lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Instance network_info: |[{"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] Acquired lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.network.neutron [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Refreshing network info cache for port e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:00:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Start _get_guest_xml network_info=[{"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:00:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-685597687',display_name='tempest-TestVolumeSwap-server-685597687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-685597687',id=8,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAHmDpwd8d6V7ZShu43m3DM+VXuqCz37efx1bF4F8Iilsw3tCdA0wBfvtAFjREWXXzSg0exYB6tkDlCIJegU2NH1sowpSshbq4YrXtput4s+mwv15+i3jaTlxFUI8hU9A==',key_name='tempest-keypair-642901405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf3c986433242a78b50d0ea6ce06200',ramdisk_id='',reservation_id='r-ptq9m72f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1809782791',owner_user_name='tempest-TestVolumeSwap-1809782791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570c1cf2722e475d9d8f9878111d2e88',uuid=1cf349d6-c215-44b0-a72e-cbc49d925aa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converting VIF {"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:00:05 user nova-compute[75279]:   <uuid>1cf349d6-c215-44b0-a72e-cbc49d925aa4</uuid>
Nov 11 00:00:05 user nova-compute[75279]:   <name>instance-00000008</name>
Nov 11 00:00:05 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:00:05 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:00:05 user nova-compute[75279]:   <metadata>
Nov 11 00:00:05 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:00:05 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:name>tempest-TestVolumeSwap-server-685597687</nova:name>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:00:04</nova:creationTime>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:00:05 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:00:05 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:owner>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:user uuid="570c1cf2722e475d9d8f9878111d2e88">tempest-TestVolumeSwap-1809782791-project-member</nova:user>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:project uuid="7cf3c986433242a78b50d0ea6ce06200">tempest-TestVolumeSwap-1809782791</nova:project>
Nov 11 00:00:05 user nova-compute[75279]:       </nova:owner>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:00:05 user nova-compute[75279]:       <nova:ports>
Nov 11 00:00:05 user nova-compute[75279]:         <nova:port uuid="e05beeaa-cf6b-4c10-b339-9447bae8fde8">
Nov 11 00:00:05 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:00:05 user nova-compute[75279]:         </nova:port>
Nov 11 00:00:05 user nova-compute[75279]:       </nova:ports>
Nov 11 00:00:05 user nova-compute[75279]:     </nova:instance>
Nov 11 00:00:05 user nova-compute[75279]:   </metadata>
Nov 11 00:00:05 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:00:05 user nova-compute[75279]:     <system>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="serial">1cf349d6-c215-44b0-a72e-cbc49d925aa4</entry>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="uuid">1cf349d6-c215-44b0-a72e-cbc49d925aa4</entry>
Nov 11 00:00:05 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:00:05 user nova-compute[75279]:     </system>
Nov 11 00:00:05 user nova-compute[75279]:   </sysinfo>
Nov 11 00:00:05 user nova-compute[75279]:   <os>
Nov 11 00:00:05 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:00:05 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:00:05 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:00:05 user nova-compute[75279]:   </os>
Nov 11 00:00:05 user nova-compute[75279]:   <features>
Nov 11 00:00:05 user nova-compute[75279]:     <acpi/>
Nov 11 00:00:05 user nova-compute[75279]:     <apic/>
Nov 11 00:00:05 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:00:05 user nova-compute[75279]:   </features>
Nov 11 00:00:05 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:00:05 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:00:05 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:00:05 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:00:05 user nova-compute[75279]:   </clock>
Nov 11 00:00:05 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:00:05 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:00:05 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:00:05 user nova-compute[75279]:   </cpu>
Nov 11 00:00:05 user nova-compute[75279]:   <devices>
Nov 11 00:00:05 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:00:05 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:00:05 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk"/>
Nov 11 00:00:05 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:00:05 user nova-compute[75279]:     </disk>
Nov 11 00:00:05 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:00:05 user nova-compute[75279]:       <mac address="fa:16:3e:9b:cc:43"/>
Nov 11 00:00:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:00:05 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:00:05 user nova-compute[75279]:       <target dev="tape05beeaa-cf"/>
Nov 11 00:00:05 user nova-compute[75279]:     </interface>
Nov 11 00:00:05 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:00:05 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/console.log" append="off"/>
Nov 11 00:00:05 user nova-compute[75279]:     </serial>
Nov 11 00:00:05 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:00:05 user nova-compute[75279]:     <video>
Nov 11 00:00:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:00:05 user nova-compute[75279]:     </video>
Nov 11 00:00:05 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:00:05 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:00:05 user nova-compute[75279]:     </rng>
Nov 11 00:00:05 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:00:05 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:00:05 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:00:05 user nova-compute[75279]:     </memballoon>
Nov 11 00:00:05 user nova-compute[75279]:   </devices>
Nov 11 00:00:05 user nova-compute[75279]: </domain>
Nov 11 00:00:05 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-685597687',display_name='tempest-TestVolumeSwap-server-685597687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-685597687',id=8,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAHmDpwd8d6V7ZShu43m3DM+VXuqCz37efx1bF4F8Iilsw3tCdA0wBfvtAFjREWXXzSg0exYB6tkDlCIJegU2NH1sowpSshbq4YrXtput4s+mwv15+i3jaTlxFUI8hU9A==',key_name='tempest-keypair-642901405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf3c986433242a78b50d0ea6ce06200',ramdisk_id='',reservation_id='r-ptq9m72f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1809782791',owner_user_name='tempest-TestVolumeSwap-1809782791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570c1cf2722e475d9d8f9878111d2e88',uuid=1cf349d6-c215-44b0-a72e-cbc49d925aa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converting VIF {"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG os_vif [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f940cde5-0bd0-56fb-acd1-ecad71fd0c60', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape05beeaa-cf, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape05beeaa-cf, col_values=(('qos', UUID('32c79c46-3d7d-40a3-a12a-2a9c775f3092')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape05beeaa-cf, col_values=(('external_ids', {'iface-id': 'e05beeaa-cf6b-4c10-b339-9447bae8fde8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:cc:43', 'vm-uuid': '1cf349d6-c215-44b0-a72e-cbc49d925aa4'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:00:05 user nova-compute[75279]: INFO os_vif [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf')
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] No VIF found with MAC fa:16:3e:9b:cc:43, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.neutron [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updated VIF entry in instance network info cache for port e05beeaa-cf6b-4c10-b339-9447bae8fde8. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG nova.network.neutron [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating instance_info_cache with network_info: [{"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:00:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d5c04bdb-b470-468b-82ed-33bbb81d137f req-e5ad1d93-f70a-4d48-878e-f6a45aa0a0d3 service nova] Releasing lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:00:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] No waiting events found dispatching network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:08 user nova-compute[75279]: WARNING nova.compute.manager [req-87233600-5dd1-47a4-a91a-02f4a1ca5e08 req-c0101382-e93b-40c5-aa46-6f66d2c93d4c service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received unexpected event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 for instance with vm_state building and task_state spawning.
Nov 11 00:00:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] No waiting events found dispatching network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:10 user nova-compute[75279]: WARNING nova.compute.manager [req-976974af-2eaa-4c73-9ff0-4fbd66054521 req-564a8748-fef5-4862-8093-53f6bf5a684b service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received unexpected event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 for instance with vm_state building and task_state spawning.
Nov 11 00:00:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:00:10 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Instance spawned successfully.
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:10 user nova-compute[75279]: INFO nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Took 8.55 seconds to spawn the instance on the hypervisor.
Nov 11 00:00:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:00:10 user nova-compute[75279]: INFO nova.compute.manager [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Took 9.71 seconds to build instance.
Nov 11 00:00:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2c77c516-333e-4777-ad9a-ba6d324eb727 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.934s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:00:12 user nova-compute[75279]: INFO nova.compute.claims [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Claim successful on node user
Nov 11 00:00:12 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] No waiting events found dispatching network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:13 user nova-compute[75279]: WARNING nova.compute.manager [req-51d9b61c-607c-4d9a-8fba-7cabd54b7027 req-5c9755a3-5f47-4849-b0d0-f7c151680d2b service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received unexpected event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 for instance with vm_state active and task_state None.
Nov 11 00:00:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.policy [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f7ac3811cf540c8846902946753dabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a703c3ee0fd48c5b8d875a38dfd033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:00:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Creating image(s)
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "/opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "/opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk 1073741824" returned: 0 in 0.071s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.304s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Successfully created port: 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Cannot resize image /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Ensure instance console log exists: /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] No waiting events found dispatching network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:15 user nova-compute[75279]: WARNING nova.compute.manager [req-7ac133e9-5055-4732-beb6-559e2790a4d7 req-2979f2e7-9f22-411d-b979-57ce1b9a369d service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received unexpected event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 for instance with vm_state active and task_state None.
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Successfully updated port: 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquired lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-changed-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Refreshing instance network info cache due to event network-changed-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] Acquiring lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updating instance_info_cache with network_info: [{"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Releasing lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Instance network_info: |[{"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] Acquired lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.neutron [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Refreshing network info cache for port 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Start _get_guest_xml network_info=[{"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:00:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-951838691',display_name='tempest-VolumesAssistedSnapshotsTest-server-951838691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-951838691',id=9,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHehf6ZpCTqLUAjkPfuk7SfV57cgz7fw800ixHmPepYonE3Olv7WVoVP/dVduprdOi8qGOmlq+MKgmgcxz/xTOdYpc8PDPcNMkiOyTqRZq3ex5/O34DodL8sYSRdvX2kvg==',key_name='tempest-keypair-160638828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a703c3ee0fd48c5b8d875a38dfd033f',ramdisk_id='',reservation_id='r-qhc1s596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1748447564',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1748447564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7ac3811cf540c8846902946753dabd',uuid=8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converting VIF {"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:00:15 user nova-compute[75279]:   <uuid>8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea</uuid>
Nov 11 00:00:15 user nova-compute[75279]:   <name>instance-00000009</name>
Nov 11 00:00:15 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:00:15 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:00:15 user nova-compute[75279]:   <metadata>
Nov 11 00:00:15 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:00:15 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-951838691</nova:name>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:00:15</nova:creationTime>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:00:15 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:00:15 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:owner>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:user uuid="2f7ac3811cf540c8846902946753dabd">tempest-VolumesAssistedSnapshotsTest-1748447564-project-member</nova:user>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:project uuid="2a703c3ee0fd48c5b8d875a38dfd033f">tempest-VolumesAssistedSnapshotsTest-1748447564</nova:project>
Nov 11 00:00:15 user nova-compute[75279]:       </nova:owner>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:00:15 user nova-compute[75279]:       <nova:ports>
Nov 11 00:00:15 user nova-compute[75279]:         <nova:port uuid="820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7">
Nov 11 00:00:15 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:00:15 user nova-compute[75279]:         </nova:port>
Nov 11 00:00:15 user nova-compute[75279]:       </nova:ports>
Nov 11 00:00:15 user nova-compute[75279]:     </nova:instance>
Nov 11 00:00:15 user nova-compute[75279]:   </metadata>
Nov 11 00:00:15 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:00:15 user nova-compute[75279]:     <system>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="serial">8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea</entry>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="uuid">8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea</entry>
Nov 11 00:00:15 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:00:15 user nova-compute[75279]:     </system>
Nov 11 00:00:15 user nova-compute[75279]:   </sysinfo>
Nov 11 00:00:15 user nova-compute[75279]:   <os>
Nov 11 00:00:15 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:00:15 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:00:15 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:00:15 user nova-compute[75279]:   </os>
Nov 11 00:00:15 user nova-compute[75279]:   <features>
Nov 11 00:00:15 user nova-compute[75279]:     <acpi/>
Nov 11 00:00:15 user nova-compute[75279]:     <apic/>
Nov 11 00:00:15 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:00:15 user nova-compute[75279]:   </features>
Nov 11 00:00:15 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:00:15 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:00:15 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:00:15 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:00:15 user nova-compute[75279]:   </clock>
Nov 11 00:00:15 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:00:15 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:00:15 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:00:15 user nova-compute[75279]:   </cpu>
Nov 11 00:00:15 user nova-compute[75279]:   <devices>
Nov 11 00:00:15 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:00:15 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:00:15 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk"/>
Nov 11 00:00:15 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:00:15 user nova-compute[75279]:     </disk>
Nov 11 00:00:15 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:00:15 user nova-compute[75279]:       <mac address="fa:16:3e:35:f9:53"/>
Nov 11 00:00:15 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:00:15 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:00:15 user nova-compute[75279]:       <target dev="tap820a6421-7c"/>
Nov 11 00:00:15 user nova-compute[75279]:     </interface>
Nov 11 00:00:15 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:00:15 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/console.log" append="off"/>
Nov 11 00:00:15 user nova-compute[75279]:     </serial>
Nov 11 00:00:15 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:00:15 user nova-compute[75279]:     <video>
Nov 11 00:00:15 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:00:15 user nova-compute[75279]:     </video>
Nov 11 00:00:15 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:00:15 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:00:15 user nova-compute[75279]:     </rng>
Nov 11 00:00:15 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:00:15 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:00:15 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:00:15 user nova-compute[75279]:     </memballoon>
Nov 11 00:00:15 user nova-compute[75279]:   </devices>
Nov 11 00:00:15 user nova-compute[75279]: </domain>
Nov 11 00:00:15 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-951838691',display_name='tempest-VolumesAssistedSnapshotsTest-server-951838691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-951838691',id=9,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHehf6ZpCTqLUAjkPfuk7SfV57cgz7fw800ixHmPepYonE3Olv7WVoVP/dVduprdOi8qGOmlq+MKgmgcxz/xTOdYpc8PDPcNMkiOyTqRZq3ex5/O34DodL8sYSRdvX2kvg==',key_name='tempest-keypair-160638828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a703c3ee0fd48c5b8d875a38dfd033f',ramdisk_id='',reservation_id='r-qhc1s596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1748447564',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1748447564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7ac3811cf540c8846902946753dabd',uuid=8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converting VIF {"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG os_vif [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f83abe2f-540c-5412-8a87-e0b05e533dd1', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap820a6421-7c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap820a6421-7c, col_values=(('qos', UUID('3f9b94ec-0f62-41f5-abad-f032291bfa3a')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap820a6421-7c, col_values=(('external_ids', {'iface-id': '820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:f9:53', 'vm-uuid': '8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:15 user nova-compute[75279]: INFO os_vif [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c')
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:00:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] No VIF found with MAC fa:16:3e:35:f9:53, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updated VIF entry in instance network info cache for port 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updating instance_info_cache with network_info: [{"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-662ceefc-9d61-4322-b8d8-212cd89270b3 req-bd54a4b4-4d0b-4837-b2fd-d10278317ed6 service nova] Releasing lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:16 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] No waiting events found dispatching network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:17 user nova-compute[75279]: WARNING nova.compute.manager [req-e4636e58-98c6-4756-b151-d3ebd2edc3b9 req-72aab438-516b-4642-9240-3ff134edf56e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received unexpected event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 for instance with vm_state building and task_state spawning.
Nov 11 00:00:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] No waiting events found dispatching network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:00:19 user nova-compute[75279]: WARNING nova.compute.manager [req-2c8587a2-7b44-4326-af9d-c53a21ad14ef req-94412acb-9e45-4eb1-87cc-43ca92c1b723 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received unexpected event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 for instance with vm_state building and task_state spawning.
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:00:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Instance spawned successfully.
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:20 user nova-compute[75279]: INFO nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 11 00:00:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:00:20 user nova-compute[75279]: INFO nova.compute.manager [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Took 8.20 seconds to build instance.
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28986af8-bd2d-4949-894b-2c930401fc5f tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.350s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:00:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:00:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:00:22 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=25.621429443359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:00:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:00:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance ce47c153-409d-472c-a0bf-032c043aeb06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b068deff-cc78-494c-a78a-3ecbd08af62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:00:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:00:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid ce47c153-409d-472c-a0bf-032c043aeb06 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updating instance_info_cache with network_info: [{"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-ce47c153-409d-472c-a0bf-032c043aeb06" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:00:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:00:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:01:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lazy-loading 'flavor' on Instance uuid ce47c153-409d-472c-a0bf-032c043aeb06 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:14 user nova-compute[75279]: INFO nova.compute.manager [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Attaching volume bfbb22c7-38fb-440b-8bda-7cfb65dd635d to /dev/vdb
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:01:14 user nova-compute[75279]: INFO nova.compute.claims [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Claim successful on node user
Nov 11 00:01:14 user nova-compute[75279]: DEBUG os_brick.utils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:01:14 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp87etyicb/privsep.sock']
Nov 11 00:01:14 user sudo[86648]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp87etyicb/privsep.sock
Nov 11 00:01:14 user sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:01:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:01:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:01:15 user nova-compute[75279]: INFO nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Booting with volume 9f001696-cd0c-4aa6-b009-522be3395c61 at /dev/vda
Nov 11 00:01:15 user nova-compute[75279]: DEBUG nova.policy [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '203825bd4a734f71afa4800eee3a8d4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde840737cdb4da68cf69dca204e238e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:01:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:01:16 user sudo[86648]: pam_unix(sudo:session): session closed for user root
Nov 11 00:01:16 user nova-compute[75279]: INFO oslo.privsep.daemon [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Spawned new privsep daemon via rootwrap
Nov 11 00:01:16 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 11 00:01:16 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 11 00:01:16 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 11 00:01:16 user nova-compute[75279]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86651
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully created port: f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b256acf-c270-4258-a446-397c7c8f6483]: (2,) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: WARNING oslo_privsep.priv_context [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] privsep daemon already running
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-changed-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Refreshing instance network info cache due to event network-changed-c2af150b-6845-4dba-95c9-897b82ee2715. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Refreshing network info cache for port c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d266e6-6978-46c6-adda-7a3860c26c05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: WARNING os_brick.initiator.connectors.nvmeof [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b717b53c-468f-4d85-bf41-12b47cf6e621]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[88193994-062b-4d67-b844-016715dc2b34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd9ccd-1475-44e7-8182-1c77292416b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ed811e-3c9f-40c4-9490-42f7f02a3dd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c9360d-024e-4a4d-a910-c7fd02c60b8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb60905-3e6d-44e9-a25c-9ec3b74bd222]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece1033-0183-4134-98d2-d810ba9da143]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:16 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ccc43e-72f9-4482-9479-1027069cd4a7]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.utils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] <== get_connector_properties: return (1966ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updating existing volume attachment record: 6516e3ca-877b-40d5-89a7-0639c1602584 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:16 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:01:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868cce8-48fe-41b6-99f6-d523082cb98e]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== get_connector_properties: return (931ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating existing volume attachment record: 94098d49-cccd-48b8-89a8-f39ae2e115c3 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:01:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully created port: aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:01:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully created port: 68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:01:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updated VIF entry in instance network info cache for port c2af150b-6845-4dba-95c9-897b82ee2715. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:01:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9ca53af4-eafa-4483-b31d-ae4cda570414 req-d84a36fa-da34-48ad-900b-0ae1416ed94c service nova] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully created port: efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully created port: 0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a59794c-a97e-44f1-b23a-3fb1a39534ae req-1654fd55-9b48-4340-ae48-867280d329a2 service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: 5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:19 user nova-compute[75279]: INFO nova.compute.manager [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Rescuing
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: 36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:01:21 user nova-compute[75279]: WARNING nova.compute.manager [req-e0fdc747-7e7e-4a2c-985e-7b15c07a5194 req-c4e56006-05d0-4078-a10b-c01b100b5b3b service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state rescuing.
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-5ef773f1-d774-4594-8d45-3684c82d40cc. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port 5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance destroyed successfully.
Nov 11 00:01:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Attempting rescue
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:01:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Creating image(s)
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'trusted_certs' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-36116477-91dd-4b21-ab96-f31d2472f9ca. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port 36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue" returned: 0 in 0.059s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'migration_context' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.base [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<a77456b7-3d4c-40a9-94f7-661efc298e50> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start _get_guest_xml network_info=[{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:02:ee:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.base [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<a77456b7-3d4c-40a9-94f7-661efc298e50> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'numa_topology' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.base [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<a77456b7-3d4c-40a9-94f7-661efc298e50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:01:21 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:01:21 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'vcpu_model' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.base [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<a77456b7-3d4c-40a9-94f7-661efc298e50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-407627822',display_name='tempest-ServerRescueNegativeTestJSON-server-407627822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-407627822',id=4,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-ziwtxk2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:46Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=a77456b7-3d4c-40a9-94f7-661efc298e50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:02:ee:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:02:ee:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.objects.base [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<a77456b7-3d4c-40a9-94f7-661efc298e50> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:01:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:01:21 user nova-compute[75279]:   <uuid>a77456b7-3d4c-40a9-94f7-661efc298e50</uuid>
Nov 11 00:01:21 user nova-compute[75279]:   <name>instance-00000004</name>
Nov 11 00:01:21 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:01:21 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:01:21 user nova-compute[75279]:   <metadata>
Nov 11 00:01:21 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:01:21 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-407627822</nova:name>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:01:21</nova:creationTime>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:01:21 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:01:21 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:owner>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 11 00:01:21 user nova-compute[75279]:       </nova:owner>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:01:21 user nova-compute[75279]:       <nova:ports>
Nov 11 00:01:21 user nova-compute[75279]:         <nova:port uuid="395f7bdd-9cce-4d32-a364-d02403ccbd89">
Nov 11 00:01:21 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:01:21 user nova-compute[75279]:         </nova:port>
Nov 11 00:01:21 user nova-compute[75279]:       </nova:ports>
Nov 11 00:01:21 user nova-compute[75279]:     </nova:instance>
Nov 11 00:01:21 user nova-compute[75279]:   </metadata>
Nov 11 00:01:21 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:01:21 user nova-compute[75279]:     <system>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="serial">a77456b7-3d4c-40a9-94f7-661efc298e50</entry>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="uuid">a77456b7-3d4c-40a9-94f7-661efc298e50</entry>
Nov 11 00:01:21 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:01:21 user nova-compute[75279]:     </system>
Nov 11 00:01:21 user nova-compute[75279]:   </sysinfo>
Nov 11 00:01:21 user nova-compute[75279]:   <os>
Nov 11 00:01:21 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:01:21 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:01:21 user nova-compute[75279]:   </os>
Nov 11 00:01:21 user nova-compute[75279]:   <features>
Nov 11 00:01:21 user nova-compute[75279]:     <acpi/>
Nov 11 00:01:21 user nova-compute[75279]:     <apic/>
Nov 11 00:01:21 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:01:21 user nova-compute[75279]:   </features>
Nov 11 00:01:21 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:01:21 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:01:21 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:01:21 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:01:21 user nova-compute[75279]:   </clock>
Nov 11 00:01:21 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:01:21 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:01:21 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:01:21 user nova-compute[75279]:   </cpu>
Nov 11 00:01:21 user nova-compute[75279]:   <devices>
Nov 11 00:01:21 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:01:21 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:01:21 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue"/>
Nov 11 00:01:21 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:01:21 user nova-compute[75279]:     </disk>
Nov 11 00:01:21 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:01:21 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:01:21 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk"/>
Nov 11 00:01:21 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:01:21 user nova-compute[75279]:     </disk>
Nov 11 00:01:21 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:01:21 user nova-compute[75279]:       <mac address="fa:16:3e:02:ee:8d"/>
Nov 11 00:01:21 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:01:21 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:01:21 user nova-compute[75279]:       <target dev="tap395f7bdd-9c"/>
Nov 11 00:01:21 user nova-compute[75279]:     </interface>
Nov 11 00:01:21 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:01:21 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/console.log" append="off"/>
Nov 11 00:01:21 user nova-compute[75279]:     </serial>
Nov 11 00:01:21 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:01:21 user nova-compute[75279]:     <video>
Nov 11 00:01:21 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:01:21 user nova-compute[75279]:     </video>
Nov 11 00:01:21 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:01:21 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:01:21 user nova-compute[75279]:     </rng>
Nov 11 00:01:21 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:01:21 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:01:21 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:01:21 user nova-compute[75279]:     </memballoon>
Nov 11 00:01:21 user nova-compute[75279]:   </devices>
Nov 11 00:01:21 user nova-compute[75279]: </domain>
Nov 11 00:01:21 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:01:22 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance destroyed successfully.
Nov 11 00:01:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:02:ee:8d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: 68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:01:26 user nova-compute[75279]: WARNING nova.compute.manager [req-2c6352bf-7067-44c1-908b-4a653451f716 req-cf5ce97a-8da0-4d6d-8a23-8e228cddb63f service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state rescuing.
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-aa74e09b-3fa7-442a-b711-72cb34bbb90e. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing instance network info cache due to event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.network.neutron [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:01:26 user nova-compute[75279]: WARNING nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state rescuing.
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:01:26 user nova-compute[75279]: WARNING nova.compute.manager [req-0632fc53-3ce9-4a6b-8a8b-30dff56136e3 req-4efa16a9-8abc-43f7-9b05-f6f45a4efc5e service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state active and task_state rescuing.
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e7b50d58-f632-48dd-b0ec-9a0572353eea tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:01:26 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:01:26 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:01:26 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7186MB free_disk=25.516738891601562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bcff1399-0d6a-4600-8f53-c1112a13f6c5 req-784b234f-6dfd-46b7-acfc-f1fed884a73f service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance ce47c153-409d-472c-a0bf-032c043aeb06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b068deff-cc78-494c-a78a-3ecbd08af62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.objects.instance [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:01:27 user nova-compute[75279]: INFO nova.compute.manager [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Attaching volume 01ee17bc-b174-402e-a0df-27d2606c5f7b to /dev/vdb
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-68baf921-70ad-4013-a16e-b58e01f4bde6. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port 68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Successfully updated port: 0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-0a15c02b-1339-47d6-9442-9d2963df6a5c. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated VIF entry in instance network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG os_brick.utils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce1c042b-8bcc-489a-98d9-fdc4ee512773 req-9307d838-7b69-469e-bc59-e4358411e998 service nova] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a590408-d6c5-481c-9be3-29363b00054e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73df5c-1a0f-40a6-868a-1e617c03491f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70184f-30a6-452b-8d7c-be5bd325bb1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24b63c-4c87-4484-a716-6d39679f0196]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:28 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10c4c7-22d3-4bd4-bdfe-430957a1e427]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG os_brick.utils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating existing volume attachment record: 602964ae-0780-444d-8b4d-35497d7d1f3e {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-efc9d390-f79d-4610-ba90-5fcd66768433. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3c3c279d-b8aa-4433-9363-eb70aae2a652 req-3b22021d-be90-4204-bfcb-7c42b2b2882a service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port 0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f10e6d0-251e-4d0f-bff9-8546a47133be req-99e93948-6cea-48d9-b108-19ec825890b7 service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:01:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:01:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance network_info: |[{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:01:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-changed-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Refreshing instance network info cache due to event network-changed-5f1b14f8-ba61-4f27-af6c-04d430689e64. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] Acquiring lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] Acquired lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Refreshing network info cache for port 5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updated VIF entry in instance network info cache for port 5f1b14f8-ba61-4f27-af6c-04d430689e64. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:01:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updating instance_info_cache with network_info: [{"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d76e0c06-292d-4443-b3c8-43134669d80a req-68f621ca-1f4c-461f-ad73-0c0cbd4a412a service nova] Releasing lock "refresh_cache-b068deff-cc78-494c-a78a-3ecbd08af62f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-changed-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Refreshing instance network info cache due to event network-changed-37aa5ad9-060d-488b-9142-2e87dd6f6451. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] Acquiring lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] Acquired lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Refreshing network info cache for port 37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updated VIF entry in instance network info cache for port 37aa5ad9-060d-488b-9142-2e87dd6f6451. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:01:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating instance_info_cache with network_info: [{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab80e724-8247-4a94-aa8c-cd5769495b79 req-f2b65620-83dc-4e92-8eb7-f75ea4a56c7e service nova] Releasing lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:44 user nova-compute[75279]: INFO nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Booting with volume d869e579-d867-4aff-9c48-b457557535c9 at /dev/vdb
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0fc582-8303-4366-acbb-5dfefc949124]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a10d7c-9f98-44f7-8b5d-bb154fdc1a7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6fd36c-e008-4679-abe5-560dfaebfd54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff840c-4ec0-42ed-afcd-28234b7679d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:01:45 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:01:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee414c22-7843-4ba9-9443-24cbbcfc972a]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:01:45 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating existing volume attachment record: 3e2da924-442a-4880-8d29-562c3083d54c {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:01:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-changed-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Refreshing instance network info cache due to event network-changed-e05beeaa-cf6b-4c10-b339-9447bae8fde8. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] Acquiring lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] Acquired lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:01:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Refreshing network info cache for port e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:01:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updated VIF entry in instance network info cache for port e05beeaa-cf6b-4c10-b339-9447bae8fde8. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:01:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating instance_info_cache with network_info: [{"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:01:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1ebb0df7-8a3e-4186-ac68-382f138adee1 req-8cbfc2b1-ba5d-4b96-8aa3-96c7968d98e3 service nova] Releasing lock "refresh_cache-1cf349d6-c215-44b0-a72e-cbc49d925aa4" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:01:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:01:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-changed-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Refreshing instance network info cache due to event network-changed-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] Acquiring lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] Acquired lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Refreshing network info cache for port 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:03 user nova-compute[75279]: DEBUG nova.network.neutron [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updated VIF entry in instance network info cache for port 820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:02:03 user nova-compute[75279]: DEBUG nova.network.neutron [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updating instance_info_cache with network_info: [{"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f059b3d9-d312-4f9a-b146-7eeadbe09ec9 req-4e789e29-c530-4e2a-bc92-8d6daa42ac1e service nova] Releasing lock "refresh_cache-8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connector [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Factory for ISCSI on None {{(pid=75279) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJgLUwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:02:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:02:14 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e4018-becb-48a9-b4c6-1fed14c255a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:02:14 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1df675-c025-4d78-8ecd-f77d2ab94b66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d] added
Nov 11 00:02:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d9904-f40e-4874-9c45-9ac0fb22a470]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f4717-4353-4cae-b58a-1db00cda8963]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJgLUwKo {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJgLUwKo" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b51a1-cf0d-4ac8-b845-7b992f194236]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJgLUwKo'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee4844-d214-4cca-b08a-53bd206edeb0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fd24e-a382-4758-8588-cb134a93f496]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:02:14 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:02:14 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:02:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:02:14 user nova-compute[75279]: 
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfde838-bebf-457a-9960-6a78611eb7f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260]
Nov 11 00:02:14 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260] successful.
Nov 11 00:02:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9400e9-8896-4514-9e3f-f12c3a18e1dd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lazy-loading 'flavor' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d72847-8489-4d65-b4a5-b4b1db92f8fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756caed-400f-4158-b970-9c276e4f625b]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJgLUwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lazy-loading 'flavor' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:15 user nova-compute[75279]: INFO nova.compute.manager [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attaching volume 6d9ff421-7a35-450b-a284-3fa89657b853 to /dev/vdb
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:15 user nova-compute[75279]: INFO nova.compute.manager [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Attaching volume 5b95da07-e0f1-4f48-98bf-810929ed2aa0 to /dev/vdb
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7377b8aa-3606-4b82-ab86-fb53cbdfbbbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67abd6db-b3a2-4781-9425-ef8510fc6657]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758ca80-8660-4c3f-84c0-0d2889e3dac1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ce956f-e583-4a0d-b8ea-55a9adc99298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfcf99-9a0d-40b1-a4da-8ef9d1dd6080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[459fe904-890e-4313-9927-dea22adcbae5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:15 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[392725b7-19b7-418e-b4a1-43cb08b2aea2]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating existing volume attachment record: 13bbf2fc-9314-49ae-a9cb-9bdc8bef423f {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed8c14-bdf0-4f97-8d99-739c9fdb9cd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fbb93-f461-4867-9097-264cdc3b0065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:15 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef24d88-fdc6-4ca9-b4cc-79daabe5212a]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updating existing volume attachment record: 83b3d790-a8fd-4f14-9d51-10d934d01cfa {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lazy-loading 'flavor' on Instance uuid b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'flavor' on Instance uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26239353661336363', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239353661336363', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.230s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:02:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:02:15 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f0284-4e97-4d3f-b6c7-8631b6462edb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:02:15 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lazy-loading 'flavor' on Instance uuid ce47c153-409d-472c-a0bf-032c043aeb06 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1b9461-0cab-4aa7-82b1-933ad0131d7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b] added
Nov 11 00:02:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:02:15 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:02:15 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:02:15 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:02:15 user nova-compute[75279]:   <serial>bfbb22c7-38fb-440b-8bda-7cfb65dd635d</serial>
Nov 11 00:02:15 user nova-compute[75279]: </disk>
Nov 11 00:02:15 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[001c2fc8-d29f-4639-a0bd-16fd84d48e1f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d56951-eec0-4a43-8688-caa07d3eb2ef]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LenXgINA {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LenXgINA" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a6e883-fda9-4e68-8179-74d97be6556b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LenXgINA'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91261b36-db51-4390-87ab-44018892d80d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af365f-1f80-4294-9975-4ae24c441531]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c5dc52-4e28-4ece-8886-87577b27bf5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]
Nov 11 00:02:16 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.
Nov 11 00:02:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb3410-74a8-458c-b4cd-bc2845e3aaf1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e275b52-6770-42f3-bcbf-dd59ada653c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:16 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:02:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:02:16 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:02:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce8ba4-565d-4b4f-85ef-db1781dc5c75]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] No VIF found with MAC fa:16:3e:27:75:4d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:02:16 user nova-compute[75279]: INFO nova.compute.claims [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Claim successful on node user
Nov 11 00:02:16 user nova-compute[75279]: INFO nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Booting with volume 6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab at /dev/vdc
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-616e5b13-1afb-42d0-80aa-757cfe187f96 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.422s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:16 user nova-compute[75279]: INFO nova.compute.manager [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Attaching volume ee01d790-93d2-4b38-9e75-55d13d443c56 to /dev/sdc
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:17 user nova-compute[75279]: INFO nova.compute.manager [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Attaching volume 05c38cb8-dbc5-4f9e-b278-407acb7e27d8 to /dev/vdb
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:02:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:02:17 user nova-compute[75279]: INFO nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Booting with volume 7cf12de8-3b0e-4a79-b066-413cc1172e40 at /dev/vda
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== connect_volume: return (2564ms) {'type': 'block', 'scsi_wwn': '26432303235333662', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432303235333662', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.objects.instance [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:02:17 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:02:17 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:02:17 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:02:17 user nova-compute[75279]:   <serial>01ee17bc-b174-402e-a0df-27d2606c5f7b</serial>
Nov 11 00:02:17 user nova-compute[75279]: </disk>
Nov 11 00:02:17 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d71277-e9e1-4c77-b210-8f1b10e997a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.policy [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6072d84305c64a98be186846f89223cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f05cbad1a8e42c5b0d5dce7c63abd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a00381-219c-4088-9c69-f60e436051e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9939db3-846f-4df4-8b3e-f0138a4d3448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46468e1-54e8-4472-851c-d0536b390b66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425ad8d-32a6-4a4f-a4b2-d87b80a031bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8117d22-24c8-41b0-b4cc-69312aa13019]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating existing volume attachment record: a53c6bab-58f9-4d47-ab18-f9f2edbf7f0b {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2746e38b-4d1a-4b38-8e34-9452d3e60c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd930fa-39b0-4950-b045-8dfb4f04aca3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f92909-3dfd-4528-a4e0-73be7570fb04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a153e9-10b9-447f-9e50-7964d47c05f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db0282-70e2-4abc-bdd5-41072c9e8e5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc621b0-a4ad-4756-94f8-5ebb97c509ff]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52553824-46b3-4c71-ba94-b7b145e11f03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updating existing volume attachment record: a3c00f18-76d2-4490-9bed-b22ff1003a07 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62e1be-002f-4a3c-ad89-94b9340e5b54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15146ac-6edc-4c95-b5a5-51a9a380060e]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating existing volume attachment record: bd65dd11-47d7-4203-ae8a-4726a126eee5 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f5b64d-8085-4b80-935c-18b493bd475d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[07328b29-8b7d-453c-84ce-aab78e401eaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No VIF found with MAC fa:16:3e:9d:b7:6d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b819f-2c92-4009-9ff8-5b49d0bca51e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee54782-4d17-44c0-8651-f821c0bca343]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:02:17 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:02:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aab53a-746c-4790-b91f-ae4ff04cc94b]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating existing volume attachment record: 4696f168-dae9-488c-b13d-1ed4fa79fc40 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:02:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully created port: 75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully created port: 3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully created port: 7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully created port: 84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully created port: d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-75defb01-843d-43f7-b141-fa19ff74f1d0. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3192e64-0d20-48d9-b522-4b7ceca26d74 req-3f7c54b1-a120-46d9-a3ea-800ad89f9062 service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:02:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:02:22 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7525MB free_disk=25.503692626953125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:02:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-154182d5-5249-426a-b97b-9e881a2b4175. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance ce47c153-409d-472c-a0bf-032c043aeb06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b068deff-cc78-494c-a78a-3ecbd08af62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-3db542a4-ed25-415a-bf6d-5ca28f13d650. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec51a56f-8742-4354-b586-a2ade752e3d4 req-0f4799c0-40be-40c0-b8aa-f9b4ceb2bffc service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: 84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Successfully updated port: d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:02:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-7795e6b9-e3ef-452b-820b-0490c433e372. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance network_info: |[{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updated VIF entry in instance network info cache for port 7795e6b9-e3ef-452b-820b-0490c433e372. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-84c913b6-160d-4666-b821-8c9378cb7168. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updated VIF entry in instance network info cache for port 84c913b6-160d-4666-b821-8c9378cb7168. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-d9f7afa7-60a2-448b-933b-c5596ebcf9b5. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:02:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:02:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updated VIF entry in instance network info cache for port d9f7afa7-60a2-448b-933b-c5596ebcf9b5. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:02:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:02:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31023041-01ac-4b37-bb38-6c9d7d55cb73 req-b5f6c4ea-5283-476e-b426-8821b9d14ed1 service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:02:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:02:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:02:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:02:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:03:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:09 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:09 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:09 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c61d4-1b2c-42d9-b802-e427216b0b63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:09 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[426328ae-3d56-4ee8-82d7-fde5a21e8f97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853] added
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed29e523-c775-4bf8-a5cc-37bbb14672b9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyERSJhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:09 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a65cb7-995b-4879-bcbd-e69026aa49ea]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCbASHVi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCbASHVi" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1337ec-2cca-4393-a093-637f1fa377d4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCbASHVi'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8e5e9-1e2a-462a-93b0-67bf88ec1ab5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cef88b-6854-444a-822a-a2754581a4df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03a1c9-0831-4d62-b27e-42a57941f21d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]
Nov 11 00:03:09 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2770f1-ad5c-4eba-8acd-930fd8a90a7f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cefaf78-c148-4ad4-8f84-32a2fb11bef9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:09 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9b261-6f02-4aa7-b51c-5c532af3959f]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26532623336646437', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532623336646437', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.258s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:10 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:10 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lazy-loading 'flavor' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00cc35f-5fee-4168-bbfe-6cb892ddaa2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:10 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:03:10 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:10 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:03:10 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:03:10 user nova-compute[75279]:   <serial>6d9ff421-7a35-450b-a284-3fa89657b853</serial>
Nov 11 00:03:10 user nova-compute[75279]: </disk>
Nov 11 00:03:10 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1663c810-f269-46b6-87f4-d4bb9cc1867b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0] added
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b6eef1-0b29-4e37-8aca-b4450705e8e0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96ee37-4ebf-45a9-9df1-24e1e196b3ff]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyERSJhU {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyERSJhU" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85e087-8306-45a2-9369-28b2a90ba2a6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyERSJhU'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[59907ca9-7755-42bd-9c2a-a6b427a18fcb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7154ba5-f39e-44e8-84f9-c43f667721ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f02b3-e246-41eb-ac24-dda7fb3ef6a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260]
Nov 11 00:03:10 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec186ffe-a1df-4fba-bafd-f907548c56df]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6f832-8d02-485b-abd9-1bf70228d0d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a2362-0ec1-4e0d-995b-038ab05eb302]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyERSJhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] No VIF found with MAC fa:16:3e:9b:cc:43, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urkTDmgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-015e62bd-b86a-437c-b66b-7503cb7ecdd1 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 103.834s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:03:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Creating image(s)
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Ensure instance console log exists: /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Start _get_guest_xml network_info=[{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwzrjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c26db41-22a0-49e6-97b8-70fe22cac691', 'attached_at': '', 'detached_at': '', 'volume_id': '9f001696-cd0c-4aa6-b009-522be3395c61', 'serial': '9f001696-cd0c-4aa6-b009-522be3395c61'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '94098d49-cccd-48b8-89a8-f39ae2e115c3', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJvxlykT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c26db41-22a0-49e6-97b8-70fe22cac691', 'attached_at': '', 'detached_at': '', 'volume_id': 'd869e579-d867-4aff-9c48-b457557535c9', 'serial': 'd869e579-d867-4aff-9c48-b457557535c9'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': '3e2da924-442a-4880-8d29-562c3083d54c', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAmzofGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c26db41-22a0-49e6-97b8-70fe22cac691', 'attached_at': '', 'detached_at': '', 'volume_id': '6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 'serial': '6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': 'a53c6bab-58f9-4d47-ab18-f9f2edbf7f0b', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] <== connect_volume: return (2579ms) {'type': 'block', 'scsi_wwn': '26333666437396235', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333666437396235', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.289s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:11 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lazy-loading 'flavor' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwzrjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[544bb4fb-c038-4c4a-8d4a-40abf29700f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:11 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] attach device xml: <disk type="block" device="disk">
Nov 11 00:03:11 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:11 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:03:11 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:03:11 user nova-compute[75279]:   <serial>5b95da07-e0f1-4f48-98bf-810929ed2aa0</serial>
Nov 11 00:03:11 user nova-compute[75279]: </disk>
Nov 11 00:03:11 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56547c4-bf67-47b6-973e-e4a43d8f681c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56] added
Nov 11 00:03:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15e2aa-3e7a-434b-8b23-13ab5df2aba2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52183a6b-a1fe-4cff-b110-c1d1dad01c5a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v urkTDmgz {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v urkTDmgz" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3d8a51-cbeb-480a-bc9d-98fa0c8201a1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'urkTDmgz'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e24a1b6e-8683-4c82-b50a-3c9fad5ae135 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.632s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ebbd94-16a1-4e38-9c72-9fed88c74a7f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:11 user nova-compute[75279]: INFO nova.compute.manager [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Terminating instance
Nov 11 00:03:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a975ae4-fc6b-4fa6-b5c5-87563177edeb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:11 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db60a05-f6ff-4256-8423-49a98a83e80b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260]
Nov 11 00:03:12 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc27b82-1397-4b18-8e0a-7af3725c57ee]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e925458a-1224-45f7-9a95-fd24cd8a03cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a0b33-0dfd-43d1-a268-78d41369a2e6]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urkTDmgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75279) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] No VIF found with MAC fa:16:3e:35:f9:53, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-unplugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] No waiting events found dispatching network-vif-unplugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-4f6c8f54-d2d1-4e8d-b891-a0a5951ed426 req-99859893-e9b7-404e-9f1f-ab112b6d0b00 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-unplugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d506adb1-070e-4cbb-a4cd-238b4efbe69c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.141s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:12 user nova-compute[75279]: WARNING nova.compute.manager [req-ddc52748-b0ec-4337-9dc3-cd808f329d56 req-539c9cde-c535-4660-8a5f-c94f73886e22 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state active and task_state powering-off.
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Instance destroyed successfully.
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lazy-loading 'resources' on Instance uuid ce47c153-409d-472c-a0bf-032c043aeb06 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2011501669',display_name='tempest-DeleteServersTestJSON-server-2011501669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2011501669',id=1,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10808be56d234af1b53bf285fcaacc67',ramdisk_id='',reservation_id='r-330d0347',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-424882729',owner_user_name='tempest-DeleteServersTestJSON-424882729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:59:32Z,user_data=None,user_id='dcb0668b2de54aa19a660b0995652f8a',uuid=ce47c153-409d-472c-a0bf-032c043aeb06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converting VIF {"id": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "address": "fa:16:3e:27:75:4d", "network": {"id": "5f6bf045-3bfc-4506-8f09-f16fa17a31b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1318900336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10808be56d234af1b53bf285fcaacc67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap648b3236-d5", "ovs_interfaceid": "648b3236-d5b1-4539-88ba-7407b5cd35f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_vif [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap648b3236-d5, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance destroyed successfully.
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35339f2c-47c9-4e30-9e19-bc04cb255ec5) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] <== connect_volume: return (1742ms) {'type': 'block', 'scsi_wwn': '26237363035646632', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237363035646632', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.390s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:13 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lazy-loading 'flavor' on Instance uuid b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0236d-412c-4b6a-b6ac-71c39538e5c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:13 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: INFO os_vif [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:75:4d,bridge_name='br-int',has_traffic_filtering=True,id=648b3236-d5b1-4539-88ba-7407b5cd35f0,network=Network(5f6bf045-3bfc-4506-8f09-f16fa17a31b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap648b3236-d5')
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJgLUwKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1c600-e7a4-4a5b-be54-2ce30d4ef19c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61] added
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:03:13 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:13 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:03:13 user nova-compute[75279]:   <target dev="sdc" bus="scsi"/>
Nov 11 00:03:13 user nova-compute[75279]:   <serial>ee01d790-93d2-4b38-9e75-55d13d443c56</serial>
Nov 11 00:03:13 user nova-compute[75279]:   <address type="drive" controller="0" unit="2"/>
Nov 11 00:03:13 user nova-compute[75279]: </disk>
Nov 11 00:03:13 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94ad28-e872-46c5-a52d-0f9eb418ce42]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb176303-6af1-4a84-92b6-fa711d8da3e4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXkwzrjy {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-04d54f2d-124a-45bd-8241-3177ae73a86a tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.192s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXkwzrjy" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00b3d7-b073-42a4-baed-7b5b842e230f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZXkwzrjy'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f3299-9d2a-48af-b67e-3bd9d178fccc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[020af067-a865-41ef-a31c-c79bf283d8f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] volume_snapshot_create: create_info: {'snapshot_id': '1a370a63-21be-43db-bad8-1f86925617d0', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75279) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ce5e6-62a4-48a3-8df1-1e38479d2ee3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260]
Nov 11 00:03:13 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0bcc41-ba35-4c8e-ad44-5c7382480f93 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] volume_snapshot_delete: delete_info: {'volume_id': '5b95da07-e0f1-4f48-98bf-810929ed2aa0'} {{(pid=75279) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [None req-2b0bcc41-ba35-4c8e-ad44-5c7382480f93 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Traceback (most recent call last):
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     if delete_info['type'] != 'qcow2':
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] KeyError: 'type'
Nov 11 00:03:13 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] 
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] snap xml: <domainsnapshot>
Nov 11 00:03:13 user nova-compute[75279]:   <disks>
Nov 11 00:03:13 user nova-compute[75279]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 11 00:03:13 user nova-compute[75279]:       <source file="/dev/new_file"/>
Nov 11 00:03:13 user nova-compute[75279]:     </disk>
Nov 11 00:03:13 user nova-compute[75279]:     <disk name="vda" snapshot="no"/>
Nov 11 00:03:13 user nova-compute[75279]:   </disks>
Nov 11 00:03:13 user nova-compute[75279]: </domainsnapshot>
Nov 11 00:03:13 user nova-compute[75279]:  {{(pid=75279) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] Lazy-loading 'system_metadata' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a5ef9d-ae4f-44cd-b496-d2a2a3c768f6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No BDM found with device name sda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] No VIF found with MAC fa:16:3e:25:c5:f0, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f14c66-7c5d-4c25-9993-a08bb1b08024]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.761s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 00:03:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     rv = execute(f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     six.reraise(c, e, tb)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     raise value
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     rv = meth(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     self._volume_snapshot_create(context, instance, guest,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     rv = execute(f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     six.reraise(c, e, tb)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     raise value
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     rv = meth(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] 
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9514a36-a7db-441c-84b2-fbc20fb530da]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwzrjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [None req-2b0bcc41-ba35-4c8e-ad44-5c7382480f93 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c6978b84-6d9a-43a0-9d3e-53116b3fefb1)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server [None req-2b0bcc41-ba35-4c8e-ad44-5c7382480f93 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] Exception during message handling: KeyError: 'type'
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1a370a63-21be-43db-bad8-1f86925617d0 could not be found.
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise value
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1a370a63-21be-43db-bad8-1f86925617d0 could not be found. (HTTP 404) (Request-ID: req-336d7442-e2df-4d45-83c9-b59767ef99b0)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1a370a63-21be-43db-bad8-1f86925617d0 could not be found.
Nov 11 00:03:14 user nova-compute[75279]: ERROR nova.virt.libvirt.driver 
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server [None req-76e3bc9a-e6c9-4f96-a557-fae5c249bca5 tempest-VolumesAssistedSnapshotsTest-858214460 tempest-VolumesAssistedSnapshotsTest-858214460-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise value
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 11 00:03:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server 
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43fa1c2f-5cf0-4761-885b-33ab88f214b0 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.294s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.utils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf4647e-c41f-4c31-b06b-2371ca9b829a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c0070-1bee-4c54-af7b-b199fc2d79e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] Acquiring lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] Lock "ce47c153-409d-472c-a0bf-032c043aeb06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] No waiting events found dispatching network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-0700cb4e-1070-4a0d-83f9-3acac1b8ae89 req-4376fe42-1eb9-4c76-a869-8f1f827fe153 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received unexpected event network-vif-plugged-648b3236-d5b1-4539-88ba-7407b5cd35f0 for instance with vm_state active and task_state deleting.
Nov 11 00:03:14 user nova-compute[75279]: INFO nova.compute.manager [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Detaching volume 5b95da07-e0f1-4f48-98bf-810929ed2aa0
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[57263bb9-0b10-4e37-b91a-1038af74857b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc6dc6-f4fb-42d5-bc86-45eb3093fbab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5ff3e-296a-4741-9f16-ef4143f69bbe]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG os_brick.utils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:14 user nova-compute[75279]: INFO nova.virt.block_device [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Attempting to driver detach volume 5b95da07-e0f1-4f48-98bf-810929ed2aa0 from mountpoint /dev/vdb
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Attempting to detach device vdb from instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] detach device xml: <disk type="block" device="disk">
Nov 11 00:03:14 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:14 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:03:14 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:03:14 user nova-compute[75279]:   <serial>5b95da07-e0f1-4f48-98bf-810929ed2aa0</serial>
Nov 11 00:03:14 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:03:14 user nova-compute[75279]: </disk>
Nov 11 00:03:14 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:03:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Successfully detached device vdb from instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea from the persistent domain config.
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] detach device xml: <disk type="block" device="disk">
Nov 11 00:03:14 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:14 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:03:14 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:03:14 user nova-compute[75279]:   <serial>5b95da07-e0f1-4f48-98bf-810929ed2aa0</serial>
Nov 11 00:03:14 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:03:14 user nova-compute[75279]: </disk>
Nov 11 00:03:14 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:14 user nova-compute[75279]: WARNING nova.compute.manager [req-2e30f804-e6d4-458c-a511-a0392e5c2a3f req-0123872d-b471-4fce-ba50-c1a706c0b5d4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.841s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== connect_volume: return (3231ms) {'type': 'block', 'scsi_wwn': '23730633639306533', 'path': '/dev/sdg'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730633639306533', 'path': '/dev/sdg'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.796s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3735822-4c43-4fe3-b07f-511032976a68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:03:15 user nova-compute[75279]: No targets found.
Nov 11 00:03:15 user nova-compute[75279]: iSNS:
Nov 11 00:03:15 user nova-compute[75279]: No targets found.
Nov 11 00:03:15 user nova-compute[75279]: STATIC:
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d
Nov 11 00:03:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:15 user nova-compute[75279]: FIRMWARE:
Nov 11 00:03:15 user nova-compute[75279]: No targets found.
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:03:15 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:03:15 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJvxlykT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba82e100-cc13-4632-957b-b5f4ea853195]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9397d98b-c410-4dc9-9e47-c517a02116d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0448d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: INFO nova.compute.manager [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Swapping volume 6d9ff421-7a35-450b-a284-3fa89657b853 for daf1408b-dd31-406e-b15b-eef60ce1e899
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c588a498-a38b-41f1-a611-8f0f1de87902]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af29c56-0704-4f05-8a6f-7c2f3827c982]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c604d8fa-be4d-46b5-8775-b205d6518d5f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba5c88-268d-401b-bfe4-a2d8c734e884]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086184f-4131-4d8d-b462-e81726e15883]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d83cca-edac-4d9a-90a5-d53421e3d098]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260]
Nov 11 00:03:15 user nova-compute[75279]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfbb22c7-38fb-440b-8bda-7cfb65dd635d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a79388-521f-4c57-a373-1b4a9bc32e30]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] <== disconnect_volume: return (2141ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:03:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Deleting instance files /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06_del
Nov 11 00:03:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Deletion of /opt/stack/data/nova/instances/ce47c153-409d-472c-a0bf-032c043aeb06_del complete
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.317s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:15 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1098a18d-685a-48f4-b270-be8d5c6cb32a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:15 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319fd13-0e43-4c78-b826-30c8f09f50f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9] added
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75279) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 11 00:03:15 user nova-compute[75279]: INFO nova.virt.libvirt.host [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] UEFI support detected
Nov 11 00:03:15 user nova-compute[75279]: INFO nova.compute.manager [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Took 3.50 seconds to destroy the instance on the hypervisor.
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4457082-f80f-40b2-a726-aad8d544e953]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0145f48-c5cf-426d-867f-526d16f32d2b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJvxlykT {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJvxlykT" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f190c5-bb42-41cd-bc75-41a5d209930b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJvxlykT'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ccb2b4-fbd1-4354-9af5-e24c87938cc3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23dab18-ecd5-497a-93ab-29076f9dd982]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fed2c65-2eea-4633-8ac7-bd10d83321e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260]
Nov 11 00:03:15 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da66273-3e84-43b8-a24c-4397a1ebff31]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5322317-3dca-4371-812c-b19f0a7f1556]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced3785-0de6-4e3f-9cdb-322bbbcecf50]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJvxlykT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:03:16 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Took 0.61 seconds to deallocate network for instance.
Nov 11 00:03:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-5a90adf0-719c-4549-b67e-8f4a76cc691d req-91ad9281-3bf7-4176-b999-64d40d8964e8 service nova] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Received event network-vif-deleted-648b3236-d5b1-4539-88ba-7407b5cd35f0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== connect_volume: return (1661ms) {'type': 'block', 'scsi_wwn': '23466626638336134', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466626638336134', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAmzofGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:16 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:16 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:16 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d6e21c-6ba1-48f2-861a-9e1307b868a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:16 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2199ee86-dda9-40ee-960a-bd8a34ba8215]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab] added
Nov 11 00:03:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29064910-ec45-40b4-a9ea-9a6b39e6c70d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e533f03-9e5f-4f33-85f0-7e996b23768a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAmzofGv {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lAmzofGv" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf71019-ad3d-4cc8-be4a-422beeafd99c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lAmzofGv'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2036a79d-15d2-40c1-b8a5-0b55ef012100]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[912d92e3-f1ff-4426-b701-ff73b96d27fe]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ac290-3c3e-4fbc-b5d9-d745e2227fef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260]
Nov 11 00:03:17 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e12437-4650-47a5-ac83-a407fcedf437]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc8a9e-913f-4066-8e98-d2b9c6bd389f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:17 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59da8ee-1851-48e9-aa05-7567338761a6]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAmzofGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23663333932393537', 'path': '/dev/sdh'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663333932393537', 'path': '/dev/sdh'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c26db41-22a0-49e6-97b8-70fe22cac691 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:03:18 user nova-compute[75279]:   <uuid>8c26db41-22a0-49e6-97b8-70fe22cac691</uuid>
Nov 11 00:03:18 user nova-compute[75279]:   <name>instance-0000000a</name>
Nov 11 00:03:18 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:03:18 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:03:18 user nova-compute[75279]:   <metadata>
Nov 11 00:03:18 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:03:18 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:name>tempest-device-tagging-server-1135197992</nova:name>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:03:11</nova:creationTime>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:03:18 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:03:18 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:owner>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:user uuid="203825bd4a734f71afa4800eee3a8d4d">tempest-TaggedBootDevicesTest_v242-1941079119-project-member</nova:user>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:project uuid="cde840737cdb4da68cf69dca204e238e">tempest-TaggedBootDevicesTest_v242-1941079119</nova:project>
Nov 11 00:03:18 user nova-compute[75279]:       </nova:owner>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:03:18 user nova-compute[75279]:       <nova:ports>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="5ef773f1-d774-4594-8d45-3684c82d40cc">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="36116477-91dd-4b21-ab96-f31d2472f9ca">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="aa74e09b-3fa7-442a-b711-72cb34bbb90e">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="68baf921-70ad-4013-a16e-b58e01f4bde6">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="efc9d390-f79d-4610-ba90-5fcd66768433">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:         <nova:port uuid="0a15c02b-1339-47d6-9442-9d2963df6a5c">
Nov 11 00:03:18 user nova-compute[75279]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 11 00:03:18 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:18 user nova-compute[75279]:       </nova:ports>
Nov 11 00:03:18 user nova-compute[75279]:     </nova:instance>
Nov 11 00:03:18 user nova-compute[75279]:   </metadata>
Nov 11 00:03:18 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:03:18 user nova-compute[75279]:     <system>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="serial">8c26db41-22a0-49e6-97b8-70fe22cac691</entry>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="uuid">8c26db41-22a0-49e6-97b8-70fe22cac691</entry>
Nov 11 00:03:18 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:03:18 user nova-compute[75279]:     </system>
Nov 11 00:03:18 user nova-compute[75279]:   </sysinfo>
Nov 11 00:03:18 user nova-compute[75279]:   <os>
Nov 11 00:03:18 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:03:18 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:03:18 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:03:18 user nova-compute[75279]:   </os>
Nov 11 00:03:18 user nova-compute[75279]:   <features>
Nov 11 00:03:18 user nova-compute[75279]:     <acpi/>
Nov 11 00:03:18 user nova-compute[75279]:     <apic/>
Nov 11 00:03:18 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:03:18 user nova-compute[75279]:   </features>
Nov 11 00:03:18 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:03:18 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:03:18 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:03:18 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:03:18 user nova-compute[75279]:   </clock>
Nov 11 00:03:18 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:03:18 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:03:18 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:03:18 user nova-compute[75279]:   </cpu>
Nov 11 00:03:18 user nova-compute[75279]:   <devices>
Nov 11 00:03:18 user nova-compute[75279]:     <disk type="file" device="cdrom">
Nov 11 00:03:18 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 00:03:18 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/disk.config"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="hda" bus="ide"/>
Nov 11 00:03:18 user nova-compute[75279]:     </disk>
Nov 11 00:03:18 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:03:18 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:18 user nova-compute[75279]:       <source dev="/dev/sdg"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <serial>9f001696-cd0c-4aa6-b009-522be3395c61</serial>
Nov 11 00:03:18 user nova-compute[75279]:     </disk>
Nov 11 00:03:18 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:03:18 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:18 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <serial>d869e579-d867-4aff-9c48-b457557535c9</serial>
Nov 11 00:03:18 user nova-compute[75279]:     </disk>
Nov 11 00:03:18 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:03:18 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:18 user nova-compute[75279]:       <source dev="/dev/sdh"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="vdc" bus="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <serial>6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab</serial>
Nov 11 00:03:18 user nova-compute[75279]:     </disk>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:c6:da:33"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tapf84e61e8-a5"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:99:6a:ea"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tap5ef773f1-d7"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:ee:7a:24"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tap36116477-91"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:58:6d:5f"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tapaa74e09b-3f"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:bf:a7:8f"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tap68baf921-70"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:7d:d5:08"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tapefc9d390-f7"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:18 user nova-compute[75279]:       <mac address="fa:16:3e:ac:9e:e5"/>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:18 user nova-compute[75279]:       <target dev="tap0a15c02b-13"/>
Nov 11 00:03:18 user nova-compute[75279]:     </interface>
Nov 11 00:03:18 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:03:18 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/console.log" append="off"/>
Nov 11 00:03:18 user nova-compute[75279]:     </serial>
Nov 11 00:03:18 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:03:18 user nova-compute[75279]:     <video>
Nov 11 00:03:18 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:18 user nova-compute[75279]:     </video>
Nov 11 00:03:18 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:03:18 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:03:18 user nova-compute[75279]:     </rng>
Nov 11 00:03:18 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:03:18 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:03:18 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:03:18 user nova-compute[75279]:     </memballoon>
Nov 11 00:03:18 user nova-compute[75279]:   </devices>
Nov 11 00:03:18 user nova-compute[75279]: </domain>
Nov 11 00:03:18 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65dfa74a-7613-5ef9-a127-a06e08d38780', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf84e61e8-a5, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf84e61e8-a5, col_values=(('qos', UUID('bd72fc0b-0f9a-4923-9fd8-627bf3a5ad8b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf84e61e8-a5, col_values=(('external_ids', {'iface-id': 'f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:da:33', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40fed862-184c-514a-b75d-baec7cf59ab6', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef773f1-d7, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ef773f1-d7, col_values=(('qos', UUID('afee8ad2-ffee-459b-9c64-42ba488619b6')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ef773f1-d7, col_values=(('external_ids', {'iface-id': '5ef773f1-d774-4594-8d45-3684c82d40cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:6a:ea', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '508acf07-3f18-502f-8db0-e6e75921cec4', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36116477-91, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36116477-91, col_values=(('qos', UUID('bd9484c8-d192-4dd3-b6dc-c4b9eb23ea30')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36116477-91, col_values=(('external_ids', {'iface-id': '36116477-91dd-4b21-ab96-f31d2472f9ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:7a:24', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06f0ab52-892b-5a02-bf31-ecbd8e9837a5', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa74e09b-3f, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa74e09b-3f, col_values=(('qos', UUID('cb95f296-7592-47df-bfec-1cdda13c5943')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa74e09b-3f, col_values=(('external_ids', {'iface-id': 'aa74e09b-3fa7-442a-b711-72cb34bbb90e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:6d:5f', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f59aab9a-cf96-5f35-92ca-7cd0438feae2', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68baf921-70, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68baf921-70, col_values=(('qos', UUID('320cd19f-2735-48c3-988b-4954a5b9ea6b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68baf921-70, col_values=(('external_ids', {'iface-id': '68baf921-70ad-4013-a16e-b58e01f4bde6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a7:8f', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '861ba705-6996-59ed-9156-7416a9353c43', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefc9d390-f7, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefc9d390-f7, col_values=(('qos', UUID('33d59f8a-367b-4f6d-82fb-ce37be6a1f00')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefc9d390-f7, col_values=(('external_ids', {'iface-id': 'efc9d390-f79d-4610-ba90-5fcd66768433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d5:08', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02b4764d-74a2-5166-a6b4-cd5af2fbb86e', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a15c02b-13, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a15c02b-13, col_values=(('qos', UUID('0fc31a26-d779-4493-b039-6dc26f1e5ad1')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a15c02b-13, col_values=(('external_ids', {'iface-id': '0a15c02b-1339-47d6-9442-9d2963df6a5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9e:e5', 'vm-uuid': '8c26db41-22a0-49e6-97b8-70fe22cac691'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:18 user nova-compute[75279]: INFO os_vif [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13')
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] No BDM found with device name hda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] No VIF found with MAC fa:16:3e:c6:da:33, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] No VIF found with MAC fa:16:3e:bf:a7:8f, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Using config drive
Nov 11 00:03:19 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Creating config drive at /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/disk.config
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuk8l_6gp {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuk8l_6gp" returned: 0 in 0.055s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:19 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:20 user nova-compute[75279]: WARNING nova.compute.manager [req-48176181-4cff-4618-bf3b-11d6db09d31b req-48f533e1-8e73-46ab-b896-15cee6fe9066 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 for instance with vm_state building and task_state spawning.
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:21 user nova-compute[75279]: WARNING nova.compute.manager [req-765d9939-59a7-4528-9dab-96de906af971 req-3b5e5f0f-3fd8-4538-8c6a-00eeb8417f68 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc for instance with vm_state building and task_state spawning.
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:22 user nova-compute[75279]: WARNING nova.compute.manager [req-49a94284-95ae-467e-98ae-f4ed51ce4898 req-a6875f1f-ad73-4c33-bbcb-3fbf4672ed9a service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e for instance with vm_state building and task_state spawning.
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-32541195-75f5-4a8f-9210-2867afc80377 req-97ebd59f-0e7d-446f-b7c1-f33fbaaac05d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:23 user nova-compute[75279]: WARNING nova.compute.manager [req-7fc88ac7-da5f-4fa1-8343-88b281c1b5c4 req-e3ce18f6-f3ef-420e-bdbb-4fe64eddb75e service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 for instance with vm_state building and task_state spawning.
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:24 user nova-compute[75279]: WARNING nova.compute.manager [req-b50de167-2b8d-479a-9c19-70c17344a32d req-fa51ebdf-fc1f-4c2d-bd94-c9ccfec13641 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e for instance with vm_state building and task_state spawning.
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:03:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance spawned successfully.
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:03:25 user nova-compute[75279]: WARNING nova.compute.manager [req-36c7025a-938b-4a33-8b5c-80a825767b75 req-e3fd7dcf-a994-4451-a26d-b087af077063 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c for instance with vm_state building and task_state spawning.
Nov 11 00:03:25 user nova-compute[75279]: INFO nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Took 13.37 seconds to spawn the instance on the hypervisor.
Nov 11 00:03:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:25 user nova-compute[75279]: INFO nova.compute.manager [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Took 130.94 seconds to build instance.
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f674d8c-ea24-493f-ab82-3feb23c9f791 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 131.044s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (sdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=25.5279541015625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance ce47c153-409d-472c-a0bf-032c043aeb06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b068deff-cc78-494c-a78a-3ecbd08af62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:03:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:03:30 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:03:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:03:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea is timed out.
Nov 11 00:03:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Successfully detached device vdb from instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea from the live domain config.
Nov 11 00:03:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyERSJhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888dd52-c644-4c5f-93cb-b717d46c49a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:03:35 user nova-compute[75279]: No targets found.
Nov 11 00:03:35 user nova-compute[75279]: iSNS:
Nov 11 00:03:35 user nova-compute[75279]: No targets found.
Nov 11 00:03:35 user nova-compute[75279]: STATIC:
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:03:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:35 user nova-compute[75279]: FIRMWARE:
Nov 11 00:03:35 user nova-compute[75279]: No targets found.
Nov 11 00:03:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:03:35 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:03:35 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeabab2a-4332-4d14-a655-efd69903b6dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a2ac23-5a27-49a2-bea5-5666fb4b1ff8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:35 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f83141f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[111da715-fabd-470a-b9cd-1d1a57436232]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfae666-8515-4da2-b8b4-d1304e232a72]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f0814-2154-4418-aec6-ea124ef1a371]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1966acff-8dfb-4c3a-b0c6-6c0e000a8870]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfb7eaa-3639-4062-9a00-2163b21f8dec]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d40f50-6f19-4236-832a-0855646036a6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260]
Nov 11 00:03:35 user nova-compute[75279]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b95da07-e0f1-4f48-98bf-810929ed2aa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd57d79-f1c8-4658-9b7b-b78b27467a9b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] <== disconnect_volume: return (333ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:03:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899', 'serial': 'daf1408b-dd31-406e-b15b-eef60ce1e899'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d9ff421-7a35-450b-a284-3fa89657b853', 'serial'} {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:49 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:49 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:49 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2541a32-5107-482f-89d9-5b42b593f317]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:03:49 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26e6c7-cff6-4a9d-80a8-05aabdb9129b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899] added
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce4c82d-dce7-4c75-be09-75745ee4e003]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd09cff-6e3d-4863-ab4b-a4d876a14cec]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhEKBVbp {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhEKBVbp" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f89fb-4444-4398-bd84-05cd0b2acd77]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LhEKBVbp'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f09df5-14db-4b20-ac0d-805be9a1c449]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c779cc-7b8c-496e-b589-a0a82f7ba623]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d86a214-9f6a-41a2-b37e-3883417b5529]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260]
Nov 11 00:03:49 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b912d63-8028-4cb3-9447-f2721e2c65e3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec02c4-6cc8-4b75-b6a3-ed7115590a4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:49 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c84de3-2412-4c3d-85b2-18cd1c9ac562]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:03:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:03:50 user nova-compute[75279]: INFO nova.compute.manager [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] [instance: ce47c153-409d-472c-a0bf-032c043aeb06] Took 34.77 seconds to detach 1 volumes for instance.
Nov 11 00:03:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26532353235376139', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532353235376139', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:03:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lazy-loading 'flavor' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:51 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Deleted allocations for instance ce47c153-409d-472c-a0bf-032c043aeb06
Nov 11 00:03:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fe9e3faf-ee82-4057-93f5-8f33acd864e1 tempest-DeleteServersTestJSON-424882729 tempest-DeleteServersTestJSON-424882729-project-member] Lock "ce47c153-409d-472c-a0bf-032c043aeb06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 39.571s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 123731968 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 399507456 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.objects.instance [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lazy-loading 'flavor' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-505756cf-a441-47e2-b55d-672b25849e4c tempest-VolumesAssistedSnapshotsTest-1248863683 tempest-VolumesAssistedSnapshotsTest-1248863683-project-admin] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.605s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 504365056 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:53 user nova-compute[75279]: INFO nova.compute.manager [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Detaching volume ee01d790-93d2-4b38-9e75-55d13d443c56
Nov 11 00:03:53 user nova-compute[75279]: INFO nova.virt.block_device [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Attempting to driver detach volume ee01d790-93d2-4b38-9e75-55d13d443c56 from mountpoint /dev/sdc
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Attempting to detach device sdc from instance b068deff-cc78-494c-a78a-3ecbd08af62f from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:03:53 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:53 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:03:53 user nova-compute[75279]:   <target dev="sdc" bus="scsi"/>
Nov 11 00:03:53 user nova-compute[75279]:   <serial>ee01d790-93d2-4b38-9e75-55d13d443c56</serial>
Nov 11 00:03:53 user nova-compute[75279]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 11 00:03:53 user nova-compute[75279]: </disk>
Nov 11 00:03:53 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:03:53 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Successfully detached device sdc from instance b068deff-cc78-494c-a78a-3ecbd08af62f from the persistent domain config.
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b068deff-cc78-494c-a78a-3ecbd08af62f from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:03:53 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:03:53 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:03:53 user nova-compute[75279]:   <target dev="sdc" bus="scsi"/>
Nov 11 00:03:53 user nova-compute[75279]:   <serial>ee01d790-93d2-4b38-9e75-55d13d443c56</serial>
Nov 11 00:03:53 user nova-compute[75279]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 11 00:03:53 user nova-compute[75279]: </disk>
Nov 11 00:03:53 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:03:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:03:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 870318080 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:03:55 user nova-compute[75279]: INFO nova.compute.claims [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Claim successful on node user
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:03:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:03:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b128ee-a55e-4618-a646-89ec52285f4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:03:56 user nova-compute[75279]: No targets found.
Nov 11 00:03:56 user nova-compute[75279]: iSNS:
Nov 11 00:03:56 user nova-compute[75279]: No targets found.
Nov 11 00:03:56 user nova-compute[75279]: STATIC:
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:03:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:03:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:03:56 user nova-compute[75279]: FIRMWARE:
Nov 11 00:03:56 user nova-compute[75279]: No targets found.
Nov 11 00:03:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:03:56 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:03:56 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.policy [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5de431660e34578b7ef8b6b7e0577ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56bb9030efe414aa52c4aa97febfd2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[387734d7-7662-4aae-92df-2a645c1befd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b453657b-da3b-4f40-85f0-14fa5cc0ac62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:03:56 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:03:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f720028f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac424e-dd16-4deb-a767-b0d96a3d33a6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[21083dcd-e260-4d46-b4eb-035f9bdb3b36]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98dace-0f5a-4680-8557-60cbb7e88b16]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:03:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Creating image(s)
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[134331ca-c7d2-4025-9873-ee6eb3d5a43b]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc9f18-0e8d-483a-87e9-699f736cd3bf]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6034ef-53e5-47f1-8b92-eaa328f9f45d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]
Nov 11 00:03:56 user nova-compute[75279]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.
Nov 11 00:03:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45908fb9-2f83-46db-ad7d-b447e6dbb0e2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== disconnect_volume: return (418ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899', 'serial'} {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: removing Cinder connection for volume 6d9ff421-7a35-450b-a284-3fa89657b853 {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk 1073741824" returned: 0 in 0.048s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:03:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Successfully created port: a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Cannot resize image /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Ensure instance console log exists: /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Successfully updated port: a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-changed-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Refreshing instance network info cache due to event network-changed-a26cb0f9-0416-4130-919c-550a9fa12a6e. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:03:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] Acquiring lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating instance_info_cache with network_info: [{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance network_info: |[{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] Acquired lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.neutron [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Refreshing network info cache for port a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start _get_guest_xml network_info=[{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:03:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-tempest.common.compute-instance-1755139986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.objects.instance [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'pci_devices' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:03:58 user nova-compute[75279]:   <uuid>99c2acbf-6e9d-49ee-9a91-d505c7054141</uuid>
Nov 11 00:03:58 user nova-compute[75279]:   <name>instance-0000000c</name>
Nov 11 00:03:58 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:03:58 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:03:58 user nova-compute[75279]:   <metadata>
Nov 11 00:03:58 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:03:58 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:name>tempest-tempest.common.compute-instance-1755139986</nova:name>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:03:58</nova:creationTime>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:03:58 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:03:58 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:owner>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:user uuid="f5de431660e34578b7ef8b6b7e0577ab">tempest-ServerActionsTestOtherA-191498200-project-member</nova:user>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:project uuid="e56bb9030efe414aa52c4aa97febfd2e">tempest-ServerActionsTestOtherA-191498200</nova:project>
Nov 11 00:03:58 user nova-compute[75279]:       </nova:owner>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:03:58 user nova-compute[75279]:       <nova:ports>
Nov 11 00:03:58 user nova-compute[75279]:         <nova:port uuid="a26cb0f9-0416-4130-919c-550a9fa12a6e">
Nov 11 00:03:58 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:03:58 user nova-compute[75279]:         </nova:port>
Nov 11 00:03:58 user nova-compute[75279]:       </nova:ports>
Nov 11 00:03:58 user nova-compute[75279]:     </nova:instance>
Nov 11 00:03:58 user nova-compute[75279]:   </metadata>
Nov 11 00:03:58 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:03:58 user nova-compute[75279]:     <system>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="serial">99c2acbf-6e9d-49ee-9a91-d505c7054141</entry>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="uuid">99c2acbf-6e9d-49ee-9a91-d505c7054141</entry>
Nov 11 00:03:58 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:03:58 user nova-compute[75279]:     </system>
Nov 11 00:03:58 user nova-compute[75279]:   </sysinfo>
Nov 11 00:03:58 user nova-compute[75279]:   <os>
Nov 11 00:03:58 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:03:58 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:03:58 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:03:58 user nova-compute[75279]:   </os>
Nov 11 00:03:58 user nova-compute[75279]:   <features>
Nov 11 00:03:58 user nova-compute[75279]:     <acpi/>
Nov 11 00:03:58 user nova-compute[75279]:     <apic/>
Nov 11 00:03:58 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:03:58 user nova-compute[75279]:   </features>
Nov 11 00:03:58 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:03:58 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:03:58 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:03:58 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:03:58 user nova-compute[75279]:   </clock>
Nov 11 00:03:58 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:03:58 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:03:58 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:03:58 user nova-compute[75279]:   </cpu>
Nov 11 00:03:58 user nova-compute[75279]:   <devices>
Nov 11 00:03:58 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:03:58 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:03:58 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk"/>
Nov 11 00:03:58 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:03:58 user nova-compute[75279]:     </disk>
Nov 11 00:03:58 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:03:58 user nova-compute[75279]:       <mac address="fa:16:3e:35:4e:79"/>
Nov 11 00:03:58 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:58 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:03:58 user nova-compute[75279]:       <target dev="tapa26cb0f9-04"/>
Nov 11 00:03:58 user nova-compute[75279]:     </interface>
Nov 11 00:03:58 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:03:58 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/console.log" append="off"/>
Nov 11 00:03:58 user nova-compute[75279]:     </serial>
Nov 11 00:03:58 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:03:58 user nova-compute[75279]:     <video>
Nov 11 00:03:58 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:03:58 user nova-compute[75279]:     </video>
Nov 11 00:03:58 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:03:58 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:03:58 user nova-compute[75279]:     </rng>
Nov 11 00:03:58 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:03:58 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:03:58 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:03:58 user nova-compute[75279]:     </memballoon>
Nov 11 00:03:58 user nova-compute[75279]:   </devices>
Nov 11 00:03:58 user nova-compute[75279]: </domain>
Nov 11 00:03:58 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-tempest.common.compute-instance-1755139986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG os_vif [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '760ef483-e615-5c26-ad8d-88cbaed16d0f', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa26cb0f9-04, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa26cb0f9-04, col_values=(('qos', UUID('dec43e3c-fb35-4bc7-87b7-e7e35276069a')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa26cb0f9-04, col_values=(('external_ids', {'iface-id': 'a26cb0f9-0416-4130-919c-550a9fa12a6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:4e:79', 'vm-uuid': '99c2acbf-6e9d-49ee-9a91-d505c7054141'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:58 user nova-compute[75279]: INFO os_vif [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04')
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:35:4e:79, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.neutron [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updated VIF entry in instance network info cache for port a26cb0f9-0416-4130-919c-550a9fa12a6e. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG nova.network.neutron [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating instance_info_cache with network_info: [{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:03:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a190075f-204b-4b39-8dae-922e95027736 req-3f029f54-c3c1-4002-811e-092ef9820df6 service nova] Releasing lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:03:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:03:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:00 user nova-compute[75279]: WARNING nova.compute.manager [req-d41c10c8-3d21-4807-90db-6f23aae748e4 req-dda90017-cd0b-45f6-a73e-5fb4ad7b4fa0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state building and task_state spawning.
Nov 11 00:04:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:02 user nova-compute[75279]: WARNING nova.compute.manager [req-0430d549-4088-4d67-a17d-4e6deaa717c7 req-b7ab68c6-8cd3-4425-b3da-0dcc85cf49a8 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state building and task_state spawning.
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:04:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance spawned successfully.
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:04:02 user nova-compute[75279]: INFO nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 11 00:04:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:04:02 user nova-compute[75279]: INFO nova.compute.manager [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Took 7.22 seconds to build instance.
Nov 11 00:04:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-23211c87-a399-416a-b73b-9d70f8e8c0a9 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.379s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: Updating volume 6d9ff421-7a35-450b-a284-3fa89657b853 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "LhEKBVbp", "auth_password": "8EHpjXaGUN6esu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "daf1408b-dd31-406e-b15b-eef60ce1e899"}, "status": "reserved", "instance": "1cf349d6-c215-44b0-a72e-cbc49d925aa4", "attached_at": "", "detached_at": "", "volume_id": "daf1408b-dd31-406e-b15b-eef60ce1e899", "serial": "daf1408b-dd31-406e-b15b-eef60ce1e899"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899', 'no_device': None, 'attachment_id': 'b6f1208d-e572-40d8-9114-30c0eb538f6c'} {{(pid=75279) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 11 00:04:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a63c5920-c3ed-4fc3-b324-88b1361cfb18 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 55.088s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:10 user nova-compute[75279]: DEBUG os_brick.utils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4079b-6ac3-4667-9c2c-ccee138680a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[937035dc-da50-494b-b783-910ab231d2f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b998110-ad23-42fa-82c5-28ac1a72e9b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c632c-bdb6-4c39-9c04-50ef74eac972]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:04:11 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:04:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b4e5d-44c3-4011-80fe-4b673e85f409]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:04:11 user nova-compute[75279]: DEBUG os_brick.utils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:11 user nova-compute[75279]: INFO nova.compute.manager [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Swapping volume daf1408b-dd31-406e-b15b-eef60ce1e899 for 6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:04:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:14 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b068deff-cc78-494c-a78a-3ecbd08af62f is timed out.
Nov 11 00:04:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Successfully detached device sdc from instance b068deff-cc78-494c-a78a-3ecbd08af62f from the live domain config.
Nov 11 00:04:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urkTDmgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62530cb-6555-47e6-8a63-611bcb60bdd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:04:14 user nova-compute[75279]: No targets found.
Nov 11 00:04:14 user nova-compute[75279]: iSNS:
Nov 11 00:04:14 user nova-compute[75279]: No targets found.
Nov 11 00:04:14 user nova-compute[75279]: STATIC:
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:04:14 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:14 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:14 user nova-compute[75279]: FIRMWARE:
Nov 11 00:04:14 user nova-compute[75279]: No targets found.
Nov 11 00:04:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:04:14 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:04:14 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c85fcf4-54f0-4568-8d71-5f9859acf112]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6443617-25fa-4743-82f0-b833f7eb63ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:14 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0448940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53c22a0-957a-49d6-a625-72f9616a091d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550b3f0-3787-4a80-b749-d29621138e93]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f85c8-08bd-4fb7-a3b4-05a8a2c235b7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa54321-cefe-4e0d-8a30-b34fd58983fa]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d20056f-7d1a-4820-9d6d-b0b5d2b38b29]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96cbba7-76f8-4eee-94a2-575a4dcc79b0]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260]
Nov 11 00:04:14 user nova-compute[75279]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56, portal: 172.16.0.220,3260] successful.
Nov 11 00:04:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee01d790-93d2-4b38-9e75-55d13d443c56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df0ba1-3f23-439f-bf2a-f6942ab04c8d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] <== disconnect_volume: return (359ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:04:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:04:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:04:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:04:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:04:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=25.48194122314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b068deff-cc78-494c-a78a-3ecbd08af62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:04:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:04:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:04:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:04:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIpokUlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:33 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:33 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:33 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14c3e5-67e5-4015-ac70-f6bffa99e2b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:04:33 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e693b6b-c708-48d9-b868-2d16d973d1cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8] added
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d6677-65d5-48e2-851b-48fb725a87e1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9f60b-58c8-4268-8e77-e41bc7c44916]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIpokUlA {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIpokUlA" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e94f2a-1bcc-462c-b6bd-9eb9a85572fb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bIpokUlA'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7e49e-169b-43bf-8d7c-ee8ce0b65a5c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f82c364-42ee-411b-a676-141633b24073]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a89fb-123c-4c95-8291-c3429b281039]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260]
Nov 11 00:04:33 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260] successful.
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2329be4d-6c1f-4b93-ba30-d0df7ca50d3f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fca14f-adcb-463d-a84e-1ab34cb0cc6e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:33 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c5f9a-ed3e-4e60-b3ac-8935a8e33ffd]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:33 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIpokUlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26465373037303563', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373037303563', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG nova.objects.instance [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'flavor' on Instance uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:04:34 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:04:34 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:04:34 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:04:34 user nova-compute[75279]:   <serial>05c38cb8-dbc5-4f9e-b278-407acb7e27d8</serial>
Nov 11 00:04:34 user nova-compute[75279]: </disk>
Nov 11 00:04:34 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:04:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:04:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:04:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No VIF found with MAC fa:16:3e:8f:15:c7, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:04:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lazy-loading 'flavor' on Instance uuid b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a5a9e414-511c-49da-9424-72e801c574bd tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 52.555s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-39d00352-305c-4dba-8808-36bcda410580 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 149.454s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:46 user nova-compute[75279]: INFO nova.compute.manager [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Terminating instance
Nov 11 00:04:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:46 user nova-compute[75279]: INFO nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Booting with volume 9705c83f-fa20-4e11-9af7-99c81b7f5ba2 at /dev/vdb
Nov 11 00:04:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10238b-e46d-4240-a29d-420249d15d77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c6ea0-80ba-4225-a8ce-acc6271113ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:47 user nova-compute[75279]: INFO nova.compute.manager [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Terminating instance
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e03603-c5e8-416c-a14b-51d686d06749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f08353-b512-4e00-8e56-b5dfde4941cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:04:47 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345d571-28d5-4c04-bdf1-b21960de7f1f]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating existing volume attachment record: 87f1dcaf-5696-458e-ae85-1560aa644868 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-unplugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] No waiting events found dispatching network-vif-unplugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-65dc3820-5616-416c-a284-8bc54bda1309 req-22c2339c-f2a3-4852-b2b4-160e71863435 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-unplugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-39847d42-27c0-4723-bdec-a59d856c01d5 req-7cae831a-8a7f-4ae3-8526-286ea531e0c6 service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:04:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Instance destroyed successfully.
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lazy-loading 'resources' on Instance uuid 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-951838691',display_name='tempest-VolumesAssistedSnapshotsTest-server-951838691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-951838691',id=9,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHehf6ZpCTqLUAjkPfuk7SfV57cgz7fw800ixHmPepYonE3Olv7WVoVP/dVduprdOi8qGOmlq+MKgmgcxz/xTOdYpc8PDPcNMkiOyTqRZq3ex5/O34DodL8sYSRdvX2kvg==',key_name='tempest-keypair-160638828',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a703c3ee0fd48c5b8d875a38dfd033f',ramdisk_id='',reservation_id='r-qhc1s596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1748447564',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1748447564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7ac3811cf540c8846902946753dabd',uuid=8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converting VIF {"id": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "address": "fa:16:3e:35:f9:53", "network": {"id": "7465e85e-53c4-43d2-9f1b-47d122d4af06", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-887887228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a703c3ee0fd48c5b8d875a38dfd033f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap820a6421-7c", "ovs_interfaceid": "820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_vif [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap820a6421-7c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Instance destroyed successfully.
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lazy-loading 'resources' on Instance uuid b068deff-cc78-494c-a78a-3ecbd08af62f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T23:59:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-665151641',display_name='tempest-AttachSCSIVolumeTestJSON-server-665151641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-665151641',id=6,image_ref='97258f44-00c0-4d0b-b502-2745517503ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODRH7ugzyRXq2bNIADVgKKI0IBvSLwnBrYJOYRymr9qa7ZWJfdOo6CExySY7CO8knqoovBjiEJVsREAqsTt2HJSkj183nbxiPbEMT7jjv+5sbNb4Zr6jKxoiWFFmUduGQ==',key_name='tempest-keypair-2026312299',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db2b05d4a3c04e46bc65c6604034f8d8',ramdisk_id='',reservation_id='r-3zwl48fq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='97258f44-00c0-4d0b-b502-2745517503ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1367875678',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1367875678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26cb1b891501491194583c396832cf3b',uuid=b068deff-cc78-494c-a78a-3ecbd08af62f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converting VIF {"id": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "address": "fa:16:3e:25:c5:f0", "network": {"id": "572cc696-885f-43f2-8b5e-280b08faee5c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-179876009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b05d4a3c04e46bc65c6604034f8d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1b14f8-ba", "ovs_interfaceid": "5f1b14f8-ba61-4f27-af6c-04d430689e64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG os_vif [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f1b14f8-ba, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f9b94ec-0f62-41f5-abad-f032291bfa3a) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2307e27-003c-4d2b-9c15-c4f769c3aebb) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: INFO os_vif [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:f9:53,bridge_name='br-int',has_traffic_filtering=True,id=820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7,network=Network(7465e85e-53c4-43d2-9f1b-47d122d4af06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap820a6421-7c')
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Deleting instance files /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea_del
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Deletion of /opt/stack/data/nova/instances/8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea_del complete
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: INFO os_vif [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c5:f0,bridge_name='br-int',has_traffic_filtering=True,id=5f1b14f8-ba61-4f27-af6c-04d430689e64,network=Network(572cc696-885f-43f2-8b5e-280b08faee5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1b14f8-ba')
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Deleting instance files /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f_del
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Deletion of /opt/stack/data/nova/instances/b068deff-cc78-494c-a78a-3ecbd08af62f_del complete
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.compute.manager [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 11 00:04:48 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.compute.manager [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 11 00:04:48 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.compute.manager [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Detaching volume 05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:48 user nova-compute[75279]: INFO nova.virt.block_device [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Attempting to driver detach volume 05c38cb8-dbc5-4f9e-b278-407acb7e27d8 from mountpoint /dev/vdb
Nov 11 00:04:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Attempting to detach device vdb from instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:04:49 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:04:49 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:04:49 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:04:49 user nova-compute[75279]:   <serial>05c38cb8-dbc5-4f9e-b278-407acb7e27d8</serial>
Nov 11 00:04:49 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:04:49 user nova-compute[75279]: </disk>
Nov 11 00:04:49 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:04:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully detached device vdb from instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 from the persistent domain config.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:04:49 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:04:49 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:04:49 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:04:49 user nova-compute[75279]:   <serial>05c38cb8-dbc5-4f9e-b278-407acb7e27d8</serial>
Nov 11 00:04:49 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:04:49 user nova-compute[75279]: </disk>
Nov 11 00:04:49 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] Acquiring lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] No waiting events found dispatching network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: WARNING nova.compute.manager [req-1739b519-4fa1-4543-89ba-708995d99c41 req-41d32a2f-63f8-4dfb-b241-4073a8d202a1 service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received unexpected event network-vif-plugged-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 for instance with vm_state active and task_state deleting.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:04:49 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Took 1.27 seconds to deallocate network for instance.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: WARNING nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state active and task_state deleting.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: WARNING nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state active and task_state deleting.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: WARNING nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state active and task_state deleting.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-unplugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Acquiring lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] No waiting events found dispatching network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:49 user nova-compute[75279]: WARNING nova.compute.manager [req-534ee65c-3bfe-46a7-a7f1-ff717cb7f994 req-13b47e95-95cf-4904-942d-e7a85695b8fd service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received unexpected event network-vif-plugged-5f1b14f8-ba61-4f27-af6c-04d430689e64 for instance with vm_state active and task_state deleting.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-85555633-c196-43df-9684-e112dd8b69b0 req-c7f68678-dee6-46ac-8941-c86509eca68f service nova] [instance: b068deff-cc78-494c-a78a-3ecbd08af62f] Received event network-vif-deleted-5f1b14f8-ba61-4f27-af6c-04d430689e64 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:49 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:04:49 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Took 1.72 seconds to deallocate network for instance.
Nov 11 00:04:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.314s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:50 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Deleted allocations for instance b068deff-cc78-494c-a78a-3ecbd08af62f
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c23d9436-176b-42c6-ac9a-6ccaecc29c14 tempest-AttachSCSIVolumeTestJSON-1367875678 tempest-AttachSCSIVolumeTestJSON-1367875678-project-member] Lock "b068deff-cc78-494c-a78a-3ecbd08af62f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.370s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d9ff421-7a35-450b-a284-3fa89657b853', 'serial': '6d9ff421-7a35-450b-a284-3fa89657b853'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899'}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899', 'serial'} {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:50 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:50 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:50 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccab784-0d2b-4827-98de-8fb439854b73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:04:50 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef6f63-d9e1-4b45-ac13-e9018af1a80d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853] added
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b8ecb-69a0-43c0-8473-415b0bac1c59]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaea390-4ea2-4d1f-9b10-706fcb048a93]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCbASHVi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCbASHVi" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c479f30-bebe-49e9-bb0b-18fa86c00e23]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCbASHVi'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Deleted allocations for instance 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff36c3e-5c47-46c6-9023-d0d611716acc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d28db-ad9f-40ab-9b8d-4d71891828a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8649eed3-e9dc-4de2-9b2e-e4ed1c26ccc0 tempest-VolumesAssistedSnapshotsTest-1748447564 tempest-VolumesAssistedSnapshotsTest-1748447564-project-member] Lock "8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.239s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba873629-fcc8-475d-974d-27e259b75ba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]
Nov 11 00:04:50 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c97b09-62b9-4f69-90d1-c11bb905cb7c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a4159-2932-4a37-b6f1-ea5823cab5d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:50 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:50 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:04:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:51 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[487f1c5b-74a9-4c39-8bed-e9aab7239c0d]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:51 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:04:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:04:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-959722af-62f6-4e2e-a8e5-280b7983c0eb req-c01984bb-c9de-4253-80d6-3717d27cf38d service nova] [instance: 8e5c16bd-a1cd-4b46-8cfb-de4848ce58ea] Received event network-vif-deleted-820a6421-7cdb-4a1c-89cf-5f1c41e1ddd7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26532623336646437', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532623336646437', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:04:52 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lazy-loading 'flavor' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 137363456 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:53 user nova-compute[75279]: INFO nova.compute.manager [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Rescuing
Nov 11 00:04:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:04:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:04:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:54 user nova-compute[75279]: WARNING nova.compute.manager [req-7a96a813-c46d-4afe-b36d-cd3ea76fae95 req-b6f7f7ba-e794-4cb5-85c5-bb13819937c1 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state rescuing.
Nov 11 00:04:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 653262848 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance destroyed successfully.
Nov 11 00:04:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Attempting rescue
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:04:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Creating image(s)
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.242s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'migration_context' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.base [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<2bb536aa-c923-4be4-a399-e5f1270bf463> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start _get_guest_xml network_info=[{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:76:b7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.base [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<2bb536aa-c923-4be4-a399-e5f1270bf463> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.base [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<2bb536aa-c923-4be4-a399-e5f1270bf463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:04:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:04:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.base [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<2bb536aa-c923-4be4-a399-e5f1270bf463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143249965',display_name='tempest-ServerRescueNegativeTestJSON-server-1143249965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143249965',id=3,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-xxwya5w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:59:47Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=2bb536aa-c923-4be4-a399-e5f1270bf463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:76:b7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:76:b7:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.objects.base [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<2bb536aa-c923-4be4-a399-e5f1270bf463> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:04:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:04:55 user nova-compute[75279]:   <uuid>2bb536aa-c923-4be4-a399-e5f1270bf463</uuid>
Nov 11 00:04:55 user nova-compute[75279]:   <name>instance-00000003</name>
Nov 11 00:04:55 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:04:55 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:04:55 user nova-compute[75279]:   <metadata>
Nov 11 00:04:55 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:04:55 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1143249965</nova:name>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:04:55</nova:creationTime>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:04:55 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:04:55 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:owner>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 11 00:04:55 user nova-compute[75279]:       </nova:owner>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:04:55 user nova-compute[75279]:       <nova:ports>
Nov 11 00:04:55 user nova-compute[75279]:         <nova:port uuid="491fd41c-8c05-4bd0-881d-3e1a7c9beec6">
Nov 11 00:04:55 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 00:04:55 user nova-compute[75279]:         </nova:port>
Nov 11 00:04:55 user nova-compute[75279]:       </nova:ports>
Nov 11 00:04:55 user nova-compute[75279]:     </nova:instance>
Nov 11 00:04:55 user nova-compute[75279]:   </metadata>
Nov 11 00:04:55 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:04:55 user nova-compute[75279]:     <system>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="serial">2bb536aa-c923-4be4-a399-e5f1270bf463</entry>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="uuid">2bb536aa-c923-4be4-a399-e5f1270bf463</entry>
Nov 11 00:04:55 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:04:55 user nova-compute[75279]:     </system>
Nov 11 00:04:55 user nova-compute[75279]:   </sysinfo>
Nov 11 00:04:55 user nova-compute[75279]:   <os>
Nov 11 00:04:55 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:04:55 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:04:55 user nova-compute[75279]:   </os>
Nov 11 00:04:55 user nova-compute[75279]:   <features>
Nov 11 00:04:55 user nova-compute[75279]:     <acpi/>
Nov 11 00:04:55 user nova-compute[75279]:     <apic/>
Nov 11 00:04:55 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:04:55 user nova-compute[75279]:   </features>
Nov 11 00:04:55 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:04:55 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:04:55 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:04:55 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:04:55 user nova-compute[75279]:   </clock>
Nov 11 00:04:55 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:04:55 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:04:55 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:04:55 user nova-compute[75279]:   </cpu>
Nov 11 00:04:55 user nova-compute[75279]:   <devices>
Nov 11 00:04:55 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:04:55 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:04:55 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue"/>
Nov 11 00:04:55 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:04:55 user nova-compute[75279]:     </disk>
Nov 11 00:04:55 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:04:55 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:04:55 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk"/>
Nov 11 00:04:55 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:04:55 user nova-compute[75279]:     </disk>
Nov 11 00:04:55 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:04:55 user nova-compute[75279]:       <mac address="fa:16:3e:76:b7:97"/>
Nov 11 00:04:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:04:55 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:04:55 user nova-compute[75279]:       <target dev="tap491fd41c-8c"/>
Nov 11 00:04:55 user nova-compute[75279]:     </interface>
Nov 11 00:04:55 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:04:55 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/console.log" append="off"/>
Nov 11 00:04:55 user nova-compute[75279]:     </serial>
Nov 11 00:04:55 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:04:55 user nova-compute[75279]:     <video>
Nov 11 00:04:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:04:55 user nova-compute[75279]:     </video>
Nov 11 00:04:55 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:04:55 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:04:55 user nova-compute[75279]:     </rng>
Nov 11 00:04:55 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:04:55 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:04:55 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:04:55 user nova-compute[75279]:     </memballoon>
Nov 11 00:04:55 user nova-compute[75279]:   </devices>
Nov 11 00:04:55 user nova-compute[75279]: </domain>
Nov 11 00:04:55 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:04:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance destroyed successfully.
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:76:b7:97, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 954204160 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:56 user nova-compute[75279]: WARNING nova.compute.manager [req-bfe8a746-e0ab-4b65-bea5-d2524aaad06a req-38ad8154-cd14-414b-86df-f9e8667dc11a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state rescuing.
Nov 11 00:04:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhEKBVbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'daf1408b-dd31-406e-b15b-eef60ce1e899'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:04:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95822b7-ba4c-4819-b7df-82707da9893d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:04:56 user nova-compute[75279]: No targets found.
Nov 11 00:04:56 user nova-compute[75279]: iSNS:
Nov 11 00:04:56 user nova-compute[75279]: No targets found.
Nov 11 00:04:56 user nova-compute[75279]: STATIC:
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:04:56 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:04:56 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:04:56 user nova-compute[75279]: FIRMWARE:
Nov 11 00:04:56 user nova-compute[75279]: No targets found.
Nov 11 00:04:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:04:56 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:04:56 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36ba517-19d8-43b8-b135-7c93263e4b12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80d7933-5b44-4f55-8d1a-5a35f52733eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:04:56 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:04:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03a9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[21587c8a-16bb-4303-b987-9a08ae192613]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5444b-c2a8-4782-9b0e-b17c6f2fb14d]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[979fc1eb-b86e-4c20-9f32-75676967c030]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:04:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9438b4-d476-4224-a4f2-63dfea92144c]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2b55c-6aaf-42cf-bbcd-206a413b8f3f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613c7f0-f0da-4256-b3c5-4ed95cd239ba]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260]
Nov 11 00:04:57 user nova-compute[75279]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899, portal: 172.16.0.220,3260] successful.
Nov 11 00:04:57 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf1408b-dd31-406e-b15b-eef60ce1e899 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[933d4354-48a2-4f4b-958b-5567e5b8f115]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] <== disconnect_volume: return (349ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1cf349d6-c215-44b0-a72e-cbc49d925aa4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d9ff421-7a35-450b-a284-3fa89657b853', 'serial'} {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: removing Cinder connection for volume daf1408b-dd31-406e-b15b-eef60ce1e899 {{(pid=75279) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] swap_volume: Updating volume daf1408b-dd31-406e-b15b-eef60ce1e899 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UCbASHVi", "auth_password": "sAjTIJ3XadrBDv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "6d9ff421-7a35-450b-a284-3fa89657b853"}, "status": "reserved", "instance": "1cf349d6-c215-44b0-a72e-cbc49d925aa4", "attached_at": "", "detached_at": "", "volume_id": "6d9ff421-7a35-450b-a284-3fa89657b853", "serial": "6d9ff421-7a35-450b-a284-3fa89657b853"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6d9ff421-7a35-450b-a284-3fa89657b853', 'no_device': None, 'attachment_id': '5f5fcb5f-2002-4abb-a5e4-96cc2205b33b'} {{(pid=75279) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f669bc8-59bc-4d7d-91b7-81559f46b2b3 tempest-TestVolumeSwap-1416247133 tempest-TestVolumeSwap-1416247133-project-admin] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 47.671s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-changed-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing instance network info cache due to event network-changed-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] Acquiring lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] Acquired lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.network.neutron [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Refreshing network info cache for port f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:58 user nova-compute[75279]: WARNING nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state rescuing.
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:04:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:04:58 user nova-compute[75279]: WARNING nova.compute.manager [req-ff8055e6-929e-46f2-9153-0e0e3fb07717 req-27d249e9-60c0-43db-ab9a-767527ab94c0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state active and task_state rescuing.
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.network.neutron [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updated VIF entry in instance network info cache for port f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.network.neutron [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-81402867-fbb6-466a-99ac-ae5b694a0fe8 req-a6a8d9af-488e-4efc-bdc9-bfcd27fa55b1 service nova] Releasing lock "refresh_cache-8c26db41-22a0-49e6-97b8-70fe22cac691" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:04:59 user nova-compute[75279]: INFO nova.compute.manager [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Detaching volume 6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:04:59 user nova-compute[75279]: INFO nova.virt.block_device [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Attempting to driver detach volume 6d9ff421-7a35-450b-a284-3fa89657b853 from mountpoint /dev/vdb
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Attempting to detach device vdb from instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:04:59 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:04:59 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:04:59 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:04:59 user nova-compute[75279]:   <serial>6d9ff421-7a35-450b-a284-3fa89657b853</serial>
Nov 11 00:04:59 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:04:59 user nova-compute[75279]: </disk>
Nov 11 00:04:59 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:04:59 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Successfully detached device vdb from instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 from the persistent domain config.
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:04:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:04:59 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:04:59 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:04:59 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:04:59 user nova-compute[75279]:   <serial>6d9ff421-7a35-450b-a284-3fa89657b853</serial>
Nov 11 00:04:59 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:04:59 user nova-compute[75279]: </disk>
Nov 11 00:04:59 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:05:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-69cc907f-c695-4590-975d-5ae56c659b82 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:05:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:01 user nova-compute[75279]: INFO nova.compute.manager [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Terminating instance
Nov 11 00:05:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-ae8e3a98-7680-42fc-9681-a7c93bbb2b1c req-2f2af134-a7ce-4122-8ce8-2a3a261f0130 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-937676f2-c556-44a5-82b2-0bd25638435f req-0ceee871-ee5e-4fc1-bc7d-fa5479df3909 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-5ef773f1-d774-4594-8d45-3684c82d40cc for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-91ae5e1a-b4c8-465a-b654-0db4415a13d1 req-3c82262e-6506-4618-9154-8ffb303e31cb service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'info_cache' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Instance destroyed successfully.
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lazy-loading 'resources' on Instance uuid 8c26db41-22a0-49e6-97b8-70fe22cac691 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf84e61e8-a5, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd72fc0b-0f9a-4923-9fd8-627bf3a5ad8b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:da:33,bridge_name='br-int',has_traffic_filtering=True,id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37,network=Network(1740931e-54c9-4507-b8d3-8d5c20ab7c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e61e8-a5')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef773f1-d7, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afee8ad2-ffee-459b-9c64-42ba488619b6) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance destroyed successfully.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'resources' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2af150b-68, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:ea,bridge_name='br-int',has_traffic_filtering=True,id=5ef773f1-d774-4594-8d45-3684c82d40cc,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5ef773f1-d7')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36116477-91, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-36116477-91dd-4b21-ab96-f31d2472f9ca for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-36116477-91dd-4b21-ab96-f31d2472f9ca for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-0a15c02b-1339-47d6-9442-9d2963df6a5c for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-6266f635-2753-463d-9e4c-1e60267f5c53 req-c3c0d1e6-c02d-4fd0-a20e-3b75545400bd service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-0a15c02b-1339-47d6-9442-9d2963df6a5c for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11cbb318-6ed3-4e35-891c-4f06e0a371db) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd9484c8-d192-4dd3-b6dc-c4b9eb23ea30) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c6179f-932a-49c8-b061-2f7a313fb6f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:04 user nova-compute[75279]: No targets found.
Nov 11 00:05:04 user nova-compute[75279]: iSNS:
Nov 11 00:05:04 user nova-compute[75279]: No targets found.
Nov 11 00:05:04 user nova-compute[75279]: STATIC:
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:04 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:04 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:04 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:04 user nova-compute[75279]: No targets found.
Nov 11 00:05:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:04 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:04 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-5ef773f1-d774-4594-8d45-3684c82d40cc for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-68baf921-70ad-4013-a16e-b58e01f4bde6 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-68baf921-70ad-4013-a16e-b58e01f4bde6 for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-unplugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-unplugged-efc9d390-f79d-4610-ba90-5fcd66768433 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-cf5f65bc-90bf-48ad-ac94-58fe2bdc8ed6 req-9c1f7f3b-aa57-4149-8366-13db4027dbba service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-efc9d390-f79d-4610-ba90-5fcd66768433 for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f249e-dfcc-4930-b7aa-175e11b7c29e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=36116477-91dd-4b21-ab96-f31d2472f9ca,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36116477-91')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa74e09b-3f, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff6b7d-b8bf-4fe5-a6d7-6ee19da6fbbb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:05:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:04 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:05:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e066bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb95f296-7592-47df-bfec-1cdda13c5943) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81205e-ce4b-4e28-b79e-ea9b9a4ff596]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=aa74e09b-3fa7-442a-b711-72cb34bbb90e,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e09b-3f')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "68baf921-70ad-4013-a16e-b58e01f4bde6", "address": "fa:16:3e:bf:a7:8f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68baf921-70", "ovs_interfaceid": "68baf921-70ad-4013-a16e-b58e01f4bde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94394ffe-0a9a-4482-860f-c2172f5d2c5a]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68baf921-70, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b4c28-ea85-4d28-b088-85dc8cccb5b4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=320cd19f-2735-48c3-988b-4954a5b9ea6b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:8f,bridge_name='br-int',has_traffic_filtering=True,id=68baf921-70ad-4013-a16e-b58e01f4bde6,network=Network(26d2a1db-eff0-4db4-b7ca-df7e3ec63767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68baf921-70')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefc9d390-f7, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33d59f8a-367b-4f6d-82fb-ce37be6a1f00) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c684b1-d0c7-4735-b07b-d3991e0788ce]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] Acquiring lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] No waiting events found dispatching network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING nova.compute.manager [req-e7a80cc9-1fde-4cf3-8bb5-17aa94082c9b req-5969d809-4543-4cd5-93e0-204f99800e90 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received unexpected event network-vif-plugged-aa74e09b-3fa7-442a-b711-72cb34bbb90e for instance with vm_state active and task_state deleting.
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:08,bridge_name='br-int',has_traffic_filtering=True,id=efc9d390-f79d-4610-ba90-5fcd66768433,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc9d390-f7')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1135197992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1135197992',id=10,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMShfH+hb7aKbDSKLkVuknhYWDsqfzXOIztCbqCftbNZ650Di3U8U6+l+ckFYNTtoE1tbKo3XUHhV+opdDJurFk2kGavWk+cje/gXIDMHN1q3puRoW35yGl9+0U6rG0HkQ==',key_name='tempest-keypair-823134840',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde840737cdb4da68cf69dca204e238e',ramdisk_id='',reservation_id='r-0fsvdd04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1941079119',owner_user_name='tempest-TaggedBootDevicesTest_v242-1941079119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='203825bd4a734f71afa4800eee3a8d4d',uuid=8c26db41-22a0-49e6-97b8-70fe22cac691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converting VIF {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a15c02b-13, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fc31a26-d779-4493-b039-6dc26f1e5ad1) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:04 user nova-compute[75279]: INFO os_vif [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9e:e5,bridge_name='br-int',has_traffic_filtering=True,id=0a15c02b-1339-47d6-9442-9d2963df6a5c,network=Network(43936f70-2b83-460b-bf12-fb72cc9d5142),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a15c02b-13')
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lAmzofGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.062s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7a4015-d17b-45e1-95ab-b754da680753]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e592b-8fe1-4910-b3ea-ce7791691d04]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]
Nov 11 00:05:04 user nova-compute[75279]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2078c3-41ec-44f4-963a-06e4bb4465df]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== disconnect_volume: return (456ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.138s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start _get_guest_xml network_info=[{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '83af4515-8148-461e-9682-9c5917ad61ea', 'attached_at': '', 'detached_at': '', 'volume_id': '01ee17bc-b174-402e-a0df-27d2606c5f7b', 'serial': '01ee17bc-b174-402e-a0df-27d2606c5f7b'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '602964ae-0780-444d-8b4d-35497d7d1f3e', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'numa_topology' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a734cf-9e53-45ab-9b3f-dc97f4d8dd10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:05 user nova-compute[75279]: No targets found.
Nov 11 00:05:05 user nova-compute[75279]: iSNS:
Nov 11 00:05:05 user nova-compute[75279]: No targets found.
Nov 11 00:05:05 user nova-compute[75279]: STATIC:
Nov 11 00:05:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:05:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab
Nov 11 00:05:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:05:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:05:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:05 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:05 user nova-compute[75279]: No targets found.
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:05 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:05 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[030323f3-8c65-4280-934d-817670f67af0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:05 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f11f80-e56d-4ba7-a548-75964eeebe82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e066bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab'): ({'sdh'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Removing single pathed devices sdh {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c74069f-6918-4af7-b60b-e729a01d3efc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[61409a30-1b2b-403a-9084-904066d17322]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Flushing IO for device /dev/sdh {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5724796-5cc2-4541-b8b1-d79890f608f6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f6fdb-16f1-41ae-a4b9-38493386def7]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] SCSI volumes sdh have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61e981-b78e-45fc-acf7-aa3d6167f5d2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3045dc9-90dc-4e85-b505-062f2f2ecaa3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260]
Nov 11 00:05:05 user nova-compute[75279]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cea3f56-0b00-4628-b2b6-ab76c9ffb2ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601360d-8b2e-4db3-9e0c-cf42d86fa84a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== disconnect_volume: return (620ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.375s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:05 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:05 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:05:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwzrjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:05 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60328a-c8d4-4e20-9ede-42395903dc00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:05:05 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0ee96-f44c-405e-a18d-e4b25370469d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b] added
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea075a2-99d0-43e9-ab63-2a8144a19cfe]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e4bed-88f9-4a43-b8c1-2c6b10de98ae]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LenXgINA {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LenXgINA" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[42687c29-7e91-4564-97a0-34f49b7a8f5a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LenXgINA'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c58c9-9fe7-4bef-92cf-1cf12a310ff9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdeb402-5eaf-4427-a8a3-2882f7a519c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66041c-cc44-4f7e-8c78-f1ee6b9134fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]
Nov 11 00:05:05 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b78c9e-2067-4734-b097-f0c548325359]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[57646c0a-33f6-45b0-b138-c5068cb42f1c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f88f8-a5af-4a8b-8d9e-caee3c8a8c15]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:05:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== connect_volume: return (1837ms) {'type': 'block', 'scsi_wwn': '26432303235333662', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432303235333662', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.454s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16569fe-1f1a-47b9-b9a0-6331550af60c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:06 user nova-compute[75279]: No targets found.
Nov 11 00:05:06 user nova-compute[75279]: iSNS:
Nov 11 00:05:06 user nova-compute[75279]: No targets found.
Nov 11 00:05:06 user nova-compute[75279]: STATIC:
Nov 11 00:05:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:05:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:05:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:05:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61
Nov 11 00:05:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:06 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:06 user nova-compute[75279]: No targets found.
Nov 11 00:05:06 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:06 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:06 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'pci_devices' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:05:06 user nova-compute[75279]:   <uuid>83af4515-8148-461e-9682-9c5917ad61ea</uuid>
Nov 11 00:05:06 user nova-compute[75279]:   <name>instance-00000002</name>
Nov 11 00:05:06 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:05:06 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:05:06 user nova-compute[75279]:   <metadata>
Nov 11 00:05:06 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:05:06 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeTestJSON-server-530644997</nova:name>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:05:05</nova:creationTime>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:05:06 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:05:06 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:owner>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:user uuid="4d3793bc64e645f3b220d49f6c409904">tempest-AttachVolumeTestJSON-896218417-project-member</nova:user>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:project uuid="1be6b384229b48c4b9cf6c8f134967d1">tempest-AttachVolumeTestJSON-896218417</nova:project>
Nov 11 00:05:06 user nova-compute[75279]:       </nova:owner>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:05:06 user nova-compute[75279]:       <nova:ports>
Nov 11 00:05:06 user nova-compute[75279]:         <nova:port uuid="c2af150b-6845-4dba-95c9-897b82ee2715">
Nov 11 00:05:06 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:05:06 user nova-compute[75279]:         </nova:port>
Nov 11 00:05:06 user nova-compute[75279]:       </nova:ports>
Nov 11 00:05:06 user nova-compute[75279]:     </nova:instance>
Nov 11 00:05:06 user nova-compute[75279]:   </metadata>
Nov 11 00:05:06 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:05:06 user nova-compute[75279]:     <system>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="serial">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="uuid">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 11 00:05:06 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:05:06 user nova-compute[75279]:     </system>
Nov 11 00:05:06 user nova-compute[75279]:   </sysinfo>
Nov 11 00:05:06 user nova-compute[75279]:   <os>
Nov 11 00:05:06 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:05:06 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:05:06 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:05:06 user nova-compute[75279]:   </os>
Nov 11 00:05:06 user nova-compute[75279]:   <features>
Nov 11 00:05:06 user nova-compute[75279]:     <acpi/>
Nov 11 00:05:06 user nova-compute[75279]:     <apic/>
Nov 11 00:05:06 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:05:06 user nova-compute[75279]:   </features>
Nov 11 00:05:06 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:05:06 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:05:06 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:05:06 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:05:06 user nova-compute[75279]:   </clock>
Nov 11 00:05:06 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:05:06 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:05:06 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:05:06 user nova-compute[75279]:   </cpu>
Nov 11 00:05:06 user nova-compute[75279]:   <devices>
Nov 11 00:05:06 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:05:06 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:05:06 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk"/>
Nov 11 00:05:06 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:05:06 user nova-compute[75279]:     </disk>
Nov 11 00:05:06 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:05:06 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:05:06 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:05:06 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:05:06 user nova-compute[75279]:       <serial>01ee17bc-b174-402e-a0df-27d2606c5f7b</serial>
Nov 11 00:05:06 user nova-compute[75279]:     </disk>
Nov 11 00:05:06 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:05:06 user nova-compute[75279]:       <mac address="fa:16:3e:9d:b7:6d"/>
Nov 11 00:05:06 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:06 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:05:06 user nova-compute[75279]:       <target dev="tapc2af150b-68"/>
Nov 11 00:05:06 user nova-compute[75279]:     </interface>
Nov 11 00:05:06 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:05:06 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/console.log" append="off"/>
Nov 11 00:05:06 user nova-compute[75279]:     </serial>
Nov 11 00:05:06 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:05:06 user nova-compute[75279]:     <video>
Nov 11 00:05:06 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:06 user nova-compute[75279]:     </video>
Nov 11 00:05:06 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:05:06 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:05:06 user nova-compute[75279]:     </rng>
Nov 11 00:05:06 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:05:06 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:05:06 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:05:06 user nova-compute[75279]:     </memballoon>
Nov 11 00:05:06 user nova-compute[75279]:   </devices>
Nov 11 00:05:06 user nova-compute[75279]: </domain>
Nov 11 00:05:06 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:05:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e0a7f-a677-468f-a830-ea7721825082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56250320-9285-4927-bc30-ce69777908f3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f8314d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61'): ({'sdg'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Removing single pathed devices sdg {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b189839-770e-4d9e-bf37-245405238eb4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279f276-79fc-47eb-aa6c-3778debd2bc6]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Flushing IO for device /dev/sdg {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d288632f-8d5f-4d30-999d-b4324f7d46ac]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f792e1-bbd0-4b21-add7-cc4574c66d52]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] SCSI volumes sdg have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16260f-434e-4106-8edd-6191bacb1663]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c8b748-5d1a-470a-bcd6-b1cf45c9aab9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260]
Nov 11 00:05:07 user nova-compute[75279]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f001696-cd0c-4aa6-b009-522be3395c61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e744a336-e92f-466f-ad3d-a18f16884942]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== disconnect_volume: return (1925ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJvxlykT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:07 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe3e3b8-b1ea-4525-89bd-c073df342593]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:07 user nova-compute[75279]: No targets found.
Nov 11 00:05:07 user nova-compute[75279]: iSNS:
Nov 11 00:05:07 user nova-compute[75279]: No targets found.
Nov 11 00:05:07 user nova-compute[75279]: STATIC:
Nov 11 00:05:07 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:05:07 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:07 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:07 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9
Nov 11 00:05:07 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:07 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:07 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:05:07 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:07 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:07 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:07 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:07 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:07 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:07 user nova-compute[75279]: No targets found.
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:07 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:07 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc816f1-8679-48c9-846e-f6d4e5c10d63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[652241cf-e1fe-4291-b5dc-23127c4d2de6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:07 user nova-compute[75279]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 (non-flash)
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e070a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b749a-465d-4cd0-8bfb-9e8f927fa7b9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf5145a-893b-4dc8-b20a-92d9a64aff16]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03b45b-75bf-480e-a25e-de11a2f0c0d8]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d0f897-58df-479c-9ce4-db500a819d27]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6d189-5e20-4139-9313-45c3b6fb4f85]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.222s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9610359-96f8-4ec6-bb89-f21b675e424f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260]
Nov 11 00:05:07 user nova-compute[75279]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:07 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d869e579-d867-4aff-9c48-b457557535c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d303401-5725-405d-b96b-4282e140d7c5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] <== disconnect_volume: return (369ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Deleting instance files /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691_del
Nov 11 00:05:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Deletion of /opt/stack/data/nova/instances/8c26db41-22a0-49e6-97b8-70fe22cac691_del complete
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Cannot resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'migration_context' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:07 user nova-compute[75279]: INFO nova.compute.manager [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Took 6.06 seconds to destroy the instance on the hypervisor.
Nov 11 00:05:07 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.objects.base [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG os_vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73f7cab1-cf74-59f0-bd96-3d4316552ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2af150b-68, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2af150b-68, col_values=(('qos', UUID('d42576a3-6dd9-4ae5-890b-e1e6e443d849')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2af150b-68, col_values=(('external_ids', {'iface-id': 'c2af150b-6845-4dba-95c9-897b82ee2715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b7:6d', 'vm-uuid': '83af4515-8148-461e-9682-9c5917ad61ea'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:07 user nova-compute[75279]: INFO os_vif [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 11 00:05:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:09 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 is timed out.
Nov 11 00:05:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully detached device vdb from instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 from the live domain config.
Nov 11 00:05:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIpokUlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:09 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:09 user nova-compute[75279]: WARNING nova.compute.manager [req-95494a37-8b9d-4c92-87cb-d8a20a682447 req-e9a3303d-eff4-49e6-a051-1bcf5f75e33b service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state powering-on.
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bc9069-3e3b-4253-b5fb-cc1d329b2856]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:09 user nova-compute[75279]: No targets found.
Nov 11 00:05:09 user nova-compute[75279]: iSNS:
Nov 11 00:05:09 user nova-compute[75279]: No targets found.
Nov 11 00:05:09 user nova-compute[75279]: STATIC:
Nov 11 00:05:09 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:05:09 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:09 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:09 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8
Nov 11 00:05:09 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:09 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:09 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:09 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:09 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:09 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:09 user nova-compute[75279]: No targets found.
Nov 11 00:05:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:09 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:09 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc99f555-e65b-46c1-bdd1-d3dcef1bde11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[03211da2-75ed-4223-b6b5-36a45f739a52]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:09 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:09 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 (non-flash)
Nov 11 00:05:09 user nova-compute[75279]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:09 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f8317880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d20c076-e2a1-48d9-bde4-057afabfff58]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c2508-e020-4cb9-8598-32d31b6b7164]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99fc401-1aa8-4b55-94d2-b9ce2b898ab1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00ef6e-ee04-4344-b2da-68d6c65cf971]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23fc865-b1bb-4619-9217-fccf54c53947]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0239c0-4373-4ec9-b798-ba0e87de6879]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260]
Nov 11 00:05:09 user nova-compute[75279]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c38cb8-dbc5-4f9e-b278-407acb7e27d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a5972-0964-4dcb-a7a6-f39fca3ba9f9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] <== disconnect_volume: return (446ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'flavor' on Instance uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4c222e71-3361-4b8e-8e0b-4168aa385a13 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.685s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:11 user nova-compute[75279]: WARNING nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state powering-on.
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-deleted-68baf921-70ad-4013-a16e-b58e01f4bde6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Neutron deleted interface 68baf921-70ad-4013-a16e-b58e01f4bde6; detaching it from the instance and deleting it from the info cache
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "address": "fa:16:3e:ac:9e:e5", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a15c02b-13", "ovs_interfaceid": "0a15c02b-1339-47d6-9442-9d2963df6a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Detach interface failed, port_id=68baf921-70ad-4013-a16e-b58e01f4bde6, reason: Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-deleted-0a15c02b-1339-47d6-9442-9d2963df6a5c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Neutron deleted interface 0a15c02b-1339-47d6-9442-9d2963df6a5c; detaching it from the instance and deleting it from the info cache
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "address": "fa:16:3e:58:6d:5f", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e09b-3f", "ovs_interfaceid": "aa74e09b-3fa7-442a-b711-72cb34bbb90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Detach interface failed, port_id=0a15c02b-1339-47d6-9442-9d2963df6a5c, reason: Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-deleted-aa74e09b-3fa7-442a-b711-72cb34bbb90e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Neutron deleted interface aa74e09b-3fa7-442a-b711-72cb34bbb90e; detaching it from the instance and deleting it from the info cache
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "address": "fa:16:3e:c6:da:33", "network": {"id": "1740931e-54c9-4507-b8d3-8d5c20ab7c21", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1292155069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e61e8-a5", "ovs_interfaceid": "f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Detach interface failed, port_id=aa74e09b-3fa7-442a-b711-72cb34bbb90e, reason: Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-deleted-f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Neutron deleted interface f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37; detaching it from the instance and deleting it from the info cache
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [{"id": "5ef773f1-d774-4594-8d45-3684c82d40cc", "address": "fa:16:3e:99:6a:ea", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef773f1-d7", "ovs_interfaceid": "5ef773f1-d774-4594-8d45-3684c82d40cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36116477-91dd-4b21-ab96-f31d2472f9ca", "address": "fa:16:3e:ee:7a:24", "network": {"id": "26d2a1db-eff0-4db4-b7ca-df7e3ec63767", "bridge": "br-int", "label": "tempest-device-tagging-net1-178160724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36116477-91", "ovs_interfaceid": "36116477-91dd-4b21-ab96-f31d2472f9ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efc9d390-f79d-4610-ba90-5fcd66768433", "address": "fa:16:3e:7d:d5:08", "network": {"id": "43936f70-2b83-460b-bf12-fb72cc9d5142", "bridge": "br-int", "label": "tempest-device-tagging-net2-1962128667", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cde840737cdb4da68cf69dca204e238e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc9d390-f7", "ovs_interfaceid": "efc9d390-f79d-4610-ba90-5fcd66768433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff860b8-77d1-4146-85d8-c759b79c6d51 req-3b875762-aedc-4820-8216-8c93618aef8d service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Detach interface failed, port_id=f84e61e8-a5e3-4bf2-a3f9-6172ee5afa37, reason: Instance 8c26db41-22a0-49e6-97b8-70fe22cac691 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance rebooted successfully.
Nov 11 00:05:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f6aa46c1-5fc7-4fb6-8622-aa67c1fb60de tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:05:11 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Took 4.12 seconds to deallocate network for instance.
Nov 11 00:05:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-da0bd880-546a-4129-a62b-0a24c646e6d9 req-51c9d617-bb08-4728-b16f-f355e1e62f13 service nova] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Received event network-vif-deleted-efc9d390-f79d-4610-ba90-5fcd66768433 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:15 user nova-compute[75279]: INFO nova.compute.manager [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] [instance: 8c26db41-22a0-49e6-97b8-70fe22cac691] Took 3.57 seconds to detach 3 volumes for instance.
Nov 11 00:05:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:05:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:05:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:16 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Deleted allocations for instance 8c26db41-22a0-49e6-97b8-70fe22cac691
Nov 11 00:05:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3e9947c-506d-41cf-9728-8544b41d3b48 tempest-TaggedBootDevicesTest_v242-1941079119 tempest-TaggedBootDevicesTest_v242-1941079119-project-member] Lock "8c26db41-22a0-49e6-97b8-70fe22cac691" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.395s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:20 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 is timed out.
Nov 11 00:05:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Successfully detached device vdb from instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 from the live domain config.
Nov 11 00:05:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCbASHVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '6d9ff421-7a35-450b-a284-3fa89657b853'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:20 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[631e90aa-532c-45e6-80a0-d727e55117a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:05:20 user nova-compute[75279]: No targets found.
Nov 11 00:05:20 user nova-compute[75279]: iSNS:
Nov 11 00:05:20 user nova-compute[75279]: No targets found.
Nov 11 00:05:20 user nova-compute[75279]: STATIC:
Nov 11 00:05:20 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:05:20 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:20 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:20 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853
Nov 11 00:05:20 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:05:20 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:05:20 user nova-compute[75279]: FIRMWARE:
Nov 11 00:05:20 user nova-compute[75279]: No targets found.
Nov 11 00:05:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:05:20 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:05:20 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42513d5-c9d8-4ae1-b78f-3c516e822e05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d7403-7c94-40bd-9099-b274ba685e63]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:20 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 (non-flash)
Nov 11 00:05:20 user nova-compute[75279]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:05:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03abac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9306f537-a53f-4581-bc88-c21668699091]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[322499cb-f87a-4bac-93cf-73dfe156a148]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa0cbf0-f07a-49cd-9279-25789d01381b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d53f8-1fee-4453-b371-b59c4299cbc6]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deba8fc-c5fb-4ce9-bf86-b58f4d44bed1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca79f64e-e42a-4ca0-bd28-3196d87e3789]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260]
Nov 11 00:05:20 user nova-compute[75279]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853, portal: 172.16.0.220,3260] successful.
Nov 11 00:05:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9ff421-7a35-450b-a284-3fa89657b853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2cb39-ba4e-4a8d-b54c-ec0925bd69d5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] <== disconnect_volume: return (353ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=25.522132873535156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:05:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:05:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating instance_info_cache with network_info: [{"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-853efb46-0620-4ed9-8c5e-f3afd8ec9db7" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:05:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:05:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:05:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:33 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lazy-loading 'flavor' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5ed36ca9-5327-4845-b6ac-ca02a0d447c5 tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.454s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:05:37 user nova-compute[75279]: INFO nova.compute.claims [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Claim successful on node user
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:05:37 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.policy [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba76aa79464c4b0d8f8866630b07e332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ece3759ebf543dc8614b4ed2dd57763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:05:37 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Creating image(s)
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "/opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "/opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "/opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk 1073741824" returned: 0 in 0.054s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Successfully created port: a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.222s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Cannot resize image /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Ensure instance console log exists: /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Successfully updated port: a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquired lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-changed-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Refreshing instance network info cache due to event network-changed-a747ac01-9d33-4fe7-8189-d8f61b429423. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:05:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] Acquiring lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating instance_info_cache with network_info: [{"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Releasing lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Instance network_info: |[{"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] Acquired lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Refreshing network info cache for port a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Start _get_guest_xml network_info=[{"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:05:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1073569839',display_name='tempest-VolumesSnapshotTestJSON-instance-1073569839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1073569839',id=13,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxdQbhoVZWPr5sjUIcDybn/keoSmRvgH59M3doZHDvK5kvRAmUncXFbaxLXdW8nd/HoUyIGVTzfW3MLbOkwNtr8Uvx2akyM+gdmiNGLtW7VJI/ArPehQBwv4YxWd8cDNQ==',key_name='tempest-keypair-1655407973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-ywl1czey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=08466565-73c2-45cb-abe4-c358c1cc8d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'pci_devices' on Instance uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:05:39 user nova-compute[75279]:   <uuid>08466565-73c2-45cb-abe4-c358c1cc8d36</uuid>
Nov 11 00:05:39 user nova-compute[75279]:   <name>instance-0000000d</name>
Nov 11 00:05:39 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:05:39 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:05:39 user nova-compute[75279]:   <metadata>
Nov 11 00:05:39 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:05:39 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1073569839</nova:name>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:05:39</nova:creationTime>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:05:39 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:05:39 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:owner>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:user uuid="ba76aa79464c4b0d8f8866630b07e332">tempest-VolumesSnapshotTestJSON-567109824-project-member</nova:user>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:project uuid="2ece3759ebf543dc8614b4ed2dd57763">tempest-VolumesSnapshotTestJSON-567109824</nova:project>
Nov 11 00:05:39 user nova-compute[75279]:       </nova:owner>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:05:39 user nova-compute[75279]:       <nova:ports>
Nov 11 00:05:39 user nova-compute[75279]:         <nova:port uuid="a747ac01-9d33-4fe7-8189-d8f61b429423">
Nov 11 00:05:39 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:05:39 user nova-compute[75279]:         </nova:port>
Nov 11 00:05:39 user nova-compute[75279]:       </nova:ports>
Nov 11 00:05:39 user nova-compute[75279]:     </nova:instance>
Nov 11 00:05:39 user nova-compute[75279]:   </metadata>
Nov 11 00:05:39 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:05:39 user nova-compute[75279]:     <system>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="serial">08466565-73c2-45cb-abe4-c358c1cc8d36</entry>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="uuid">08466565-73c2-45cb-abe4-c358c1cc8d36</entry>
Nov 11 00:05:39 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:05:39 user nova-compute[75279]:     </system>
Nov 11 00:05:39 user nova-compute[75279]:   </sysinfo>
Nov 11 00:05:39 user nova-compute[75279]:   <os>
Nov 11 00:05:39 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:05:39 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:05:39 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:05:39 user nova-compute[75279]:   </os>
Nov 11 00:05:39 user nova-compute[75279]:   <features>
Nov 11 00:05:39 user nova-compute[75279]:     <acpi/>
Nov 11 00:05:39 user nova-compute[75279]:     <apic/>
Nov 11 00:05:39 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:05:39 user nova-compute[75279]:   </features>
Nov 11 00:05:39 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:05:39 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:05:39 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:05:39 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:05:39 user nova-compute[75279]:   </clock>
Nov 11 00:05:39 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:05:39 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:05:39 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:05:39 user nova-compute[75279]:   </cpu>
Nov 11 00:05:39 user nova-compute[75279]:   <devices>
Nov 11 00:05:39 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:05:39 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:05:39 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk"/>
Nov 11 00:05:39 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:05:39 user nova-compute[75279]:     </disk>
Nov 11 00:05:39 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:05:39 user nova-compute[75279]:       <mac address="fa:16:3e:03:84:10"/>
Nov 11 00:05:39 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:39 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:05:39 user nova-compute[75279]:       <target dev="tapa747ac01-9d"/>
Nov 11 00:05:39 user nova-compute[75279]:     </interface>
Nov 11 00:05:39 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:05:39 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/console.log" append="off"/>
Nov 11 00:05:39 user nova-compute[75279]:     </serial>
Nov 11 00:05:39 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:05:39 user nova-compute[75279]:     <video>
Nov 11 00:05:39 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:39 user nova-compute[75279]:     </video>
Nov 11 00:05:39 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:05:39 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:05:39 user nova-compute[75279]:     </rng>
Nov 11 00:05:39 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:05:39 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:05:39 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:05:39 user nova-compute[75279]:     </memballoon>
Nov 11 00:05:39 user nova-compute[75279]:   </devices>
Nov 11 00:05:39 user nova-compute[75279]: </domain>
Nov 11 00:05:39 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1073569839',display_name='tempest-VolumesSnapshotTestJSON-instance-1073569839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1073569839',id=13,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxdQbhoVZWPr5sjUIcDybn/keoSmRvgH59M3doZHDvK5kvRAmUncXFbaxLXdW8nd/HoUyIGVTzfW3MLbOkwNtr8Uvx2akyM+gdmiNGLtW7VJI/ArPehQBwv4YxWd8cDNQ==',key_name='tempest-keypair-1655407973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-ywl1czey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=08466565-73c2-45cb-abe4-c358c1cc8d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG os_vif [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecdf5228-f8e7-5100-b240-93c1bf7eba6d', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa747ac01-9d, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa747ac01-9d, col_values=(('qos', UUID('acc9316f-805d-4e3c-bb5a-36f1cac7d1e1')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa747ac01-9d, col_values=(('external_ids', {'iface-id': 'a747ac01-9d33-4fe7-8189-d8f61b429423', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:84:10', 'vm-uuid': '08466565-73c2-45cb-abe4-c358c1cc8d36'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:39 user nova-compute[75279]: INFO os_vif [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d')
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No VIF found with MAC fa:16:3e:03:84:10, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updated VIF entry in instance network info cache for port a747ac01-9d33-4fe7-8189-d8f61b429423. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating instance_info_cache with network_info: [{"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a4476158-b331-4689-9419-8b25765781f7 req-3092a49e-b235-414a-871c-a012e2cbbb39 service nova] Releasing lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:05:40 user nova-compute[75279]: INFO nova.compute.claims [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Claim successful on node user
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:05:41 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] No waiting events found dispatching network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:41 user nova-compute[75279]: WARNING nova.compute.manager [req-ef06a7bc-6213-414a-a581-ce34c222d8dd req-14b71678-e0b4-4f53-b752-23f815600f6e service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received unexpected event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 for instance with vm_state building and task_state spawning.
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.policy [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b84093a1d3747dab7267e4dd4a2d637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b710cbbc6b4c30b39641d41de04c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:05:41 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Creating image(s)
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "/opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "/opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "/opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk 1073741824" returned: 0 in 0.056s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Successfully created port: 203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Cannot resize image /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Ensure instance console log exists: /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Successfully updated port: 203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquired lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-changed-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Refreshing instance network info cache due to event network-changed-203d1abf-c657-4878-a147-7c120d67b289. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] Acquiring lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Updating instance_info_cache with network_info: [{"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Releasing lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Instance network_info: |[{"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] Acquired lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Refreshing network info cache for port 203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Start _get_guest_xml network_info=[{"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:05:43 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:43 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268197490',display_name='tempest-VolumesAdminNegativeTest-server-1268197490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268197490',id=14,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-s4wx6eza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:05:42Z,user_data=None,user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=b91246a8-5138-4044-bad2-4a8251b10b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'pci_devices' on Instance uuid b91246a8-5138-4044-bad2-4a8251b10b35 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:05:43 user nova-compute[75279]:   <uuid>b91246a8-5138-4044-bad2-4a8251b10b35</uuid>
Nov 11 00:05:43 user nova-compute[75279]:   <name>instance-0000000e</name>
Nov 11 00:05:43 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:05:43 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:05:43 user nova-compute[75279]:   <metadata>
Nov 11 00:05:43 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:05:43 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1268197490</nova:name>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:05:43</nova:creationTime>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:05:43 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:05:43 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:owner>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:user uuid="3b84093a1d3747dab7267e4dd4a2d637">tempest-VolumesAdminNegativeTest-2020423556-project-member</nova:user>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:project uuid="85b710cbbc6b4c30b39641d41de04c9b">tempest-VolumesAdminNegativeTest-2020423556</nova:project>
Nov 11 00:05:43 user nova-compute[75279]:       </nova:owner>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:05:43 user nova-compute[75279]:       <nova:ports>
Nov 11 00:05:43 user nova-compute[75279]:         <nova:port uuid="203d1abf-c657-4878-a147-7c120d67b289">
Nov 11 00:05:43 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:05:43 user nova-compute[75279]:         </nova:port>
Nov 11 00:05:43 user nova-compute[75279]:       </nova:ports>
Nov 11 00:05:43 user nova-compute[75279]:     </nova:instance>
Nov 11 00:05:43 user nova-compute[75279]:   </metadata>
Nov 11 00:05:43 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:05:43 user nova-compute[75279]:     <system>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="serial">b91246a8-5138-4044-bad2-4a8251b10b35</entry>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="uuid">b91246a8-5138-4044-bad2-4a8251b10b35</entry>
Nov 11 00:05:43 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:05:43 user nova-compute[75279]:     </system>
Nov 11 00:05:43 user nova-compute[75279]:   </sysinfo>
Nov 11 00:05:43 user nova-compute[75279]:   <os>
Nov 11 00:05:43 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:05:43 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:05:43 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:05:43 user nova-compute[75279]:   </os>
Nov 11 00:05:43 user nova-compute[75279]:   <features>
Nov 11 00:05:43 user nova-compute[75279]:     <acpi/>
Nov 11 00:05:43 user nova-compute[75279]:     <apic/>
Nov 11 00:05:43 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:05:43 user nova-compute[75279]:   </features>
Nov 11 00:05:43 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:05:43 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:05:43 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:05:43 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:05:43 user nova-compute[75279]:   </clock>
Nov 11 00:05:43 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:05:43 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:05:43 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:05:43 user nova-compute[75279]:   </cpu>
Nov 11 00:05:43 user nova-compute[75279]:   <devices>
Nov 11 00:05:43 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:05:43 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:05:43 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk"/>
Nov 11 00:05:43 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:05:43 user nova-compute[75279]:     </disk>
Nov 11 00:05:43 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:05:43 user nova-compute[75279]:       <mac address="fa:16:3e:39:46:24"/>
Nov 11 00:05:43 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:43 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:05:43 user nova-compute[75279]:       <target dev="tap203d1abf-c6"/>
Nov 11 00:05:43 user nova-compute[75279]:     </interface>
Nov 11 00:05:43 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:05:43 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/console.log" append="off"/>
Nov 11 00:05:43 user nova-compute[75279]:     </serial>
Nov 11 00:05:43 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:05:43 user nova-compute[75279]:     <video>
Nov 11 00:05:43 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:05:43 user nova-compute[75279]:     </video>
Nov 11 00:05:43 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:05:43 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:05:43 user nova-compute[75279]:     </rng>
Nov 11 00:05:43 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:05:43 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:05:43 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:05:43 user nova-compute[75279]:     </memballoon>
Nov 11 00:05:43 user nova-compute[75279]:   </devices>
Nov 11 00:05:43 user nova-compute[75279]: </domain>
Nov 11 00:05:43 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268197490',display_name='tempest-VolumesAdminNegativeTest-server-1268197490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268197490',id=14,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-s4wx6eza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:05:42Z,user_data=None,user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=b91246a8-5138-4044-bad2-4a8251b10b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG os_vif [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e248101a-3a72-52e8-9012-ff44e5de772f', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203d1abf-c6, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap203d1abf-c6, col_values=(('qos', UUID('aa8e0a58-f2ca-4840-970d-21e65b07125c')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap203d1abf-c6, col_values=(('external_ids', {'iface-id': '203d1abf-c657-4878-a147-7c120d67b289', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:46:24', 'vm-uuid': 'b91246a8-5138-4044-bad2-4a8251b10b35'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:43 user nova-compute[75279]: INFO os_vif [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6')
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] No VIF found with MAC fa:16:3e:39:46:24, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:05:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Instance spawned successfully.
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:43 user nova-compute[75279]: INFO nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] No waiting events found dispatching network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:43 user nova-compute[75279]: WARNING nova.compute.manager [req-cb875b16-355b-460c-a3ef-9189925749eb req-0e164755-a2c1-4576-9e14-e3076d5918ca service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received unexpected event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 for instance with vm_state building and task_state spawning.
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Updated VIF entry in instance network info cache for port 203d1abf-c657-4878-a147-7c120d67b289. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Updating instance_info_cache with network_info: [{"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e608b54-21b2-4340-99b6-22435b3826ab req-f2f9796e-7e4c-4e19-aa44-06c52822684d service nova] Releasing lock "refresh_cache-b91246a8-5138-4044-bad2-4a8251b10b35" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:43 user nova-compute[75279]: INFO nova.compute.manager [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Took 6.82 seconds to build instance.
Nov 11 00:05:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0292ae0b-f7c4-4007-a60b-470dfc993a6c tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.938s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] No waiting events found dispatching network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:45 user nova-compute[75279]: WARNING nova.compute.manager [req-38034ecc-9db0-41b0-8a94-4ff071bb058b req-8636ce16-5029-4117-866f-2241a37cd26a service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received unexpected event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 for instance with vm_state building and task_state spawning.
Nov 11 00:05:46 user nova-compute[75279]: INFO nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Booting with volume c232897b-cdf8-478e-8040-20043092ad67 at /dev/vdc
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e364b5-2d7d-40af-b5d4-f813d8b5340f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a905ea4d-f088-4da4-a10c-070581fd8d9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2fa13-e8fb-4027-bba2-d501f8a3fa51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca363c-4549-4b5b-8510-40d5ca667d16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:05:46 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:05:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[618509d3-2b25-4362-a9db-7f10285995c1]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG os_brick.utils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating existing volume attachment record: 8be1725f-4598-4413-a1d8-d864ff3618ce {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:05:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-changed-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Refreshing instance network info cache due to event network-changed-a26cb0f9-0416-4130-919c-550a9fa12a6e. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] Acquiring lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] Acquired lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.network.neutron [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Refreshing network info cache for port a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'flavor' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:05:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Instance spawned successfully.
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] No waiting events found dispatching network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:47 user nova-compute[75279]: WARNING nova.compute.manager [req-4558f195-af88-42ca-8669-29d3d9416fa5 req-a93fd72a-c12a-4662-a8c5-0d44e3669813 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received unexpected event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 for instance with vm_state building and task_state spawning.
Nov 11 00:05:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.network.neutron [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updated VIF entry in instance network info cache for port a26cb0f9-0416-4130-919c-550a9fa12a6e. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.network.neutron [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating instance_info_cache with network_info: [{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3960ac96-5ff5-400f-855a-f53d229dcf24 req-5f316a4f-f94d-435e-85ff-2dc7dbdf0539 service nova] Releasing lock "refresh_cache-99c2acbf-6e9d-49ee-9a91-d505c7054141" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:05:48 user nova-compute[75279]: INFO nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 11 00:05:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:05:48 user nova-compute[75279]: INFO nova.compute.manager [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Took 7.52 seconds to build instance.
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:48 user nova-compute[75279]: INFO nova.compute.manager [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attaching volume acc6c741-d906-4ead-898d-550c4bb5770c to /dev/vdb
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d28ac438-458c-4e0f-b0eb-8a51edff970e tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.623s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.utils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89a1d6-25b3-48da-bf55-1ad21d0265c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64f2b6e-16da-4798-93b1-eaaa5804a0e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[07475de6-512e-4356-ab98-5fd0d7845294]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0df4ad-be6f-4242-aa55-ae55898c9b05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:05:48 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:05:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb80bab-5577-42b1-a669-f27513b0162c]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG os_brick.utils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:05:48 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating existing volume attachment record: ebcbeb49-a833-49c5-ab80-7fa389d69bfa {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:05:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:50 user nova-compute[75279]: INFO nova.compute.manager [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Terminating instance
Nov 11 00:05:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-unplugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] No waiting events found dispatching network-vif-unplugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d656a70-f679-4e05-a99f-57863ae693aa req-3d6bd714-0fa2-4e5a-b28e-b2aa3663e316 service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-unplugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Instance destroyed successfully.
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.objects.instance [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lazy-loading 'resources' on Instance uuid 1cf349d6-c215-44b0-a72e-cbc49d925aa4 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-685597687',display_name='tempest-TestVolumeSwap-server-685597687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-685597687',id=8,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAHmDpwd8d6V7ZShu43m3DM+VXuqCz37efx1bF4F8Iilsw3tCdA0wBfvtAFjREWXXzSg0exYB6tkDlCIJegU2NH1sowpSshbq4YrXtput4s+mwv15+i3jaTlxFUI8hU9A==',key_name='tempest-keypair-642901405',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf3c986433242a78b50d0ea6ce06200',ramdisk_id='',reservation_id='r-ptq9m72f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1809782791',owner_user_name='tempest-TestVolumeSwap-1809782791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570c1cf2722e475d9d8f9878111d2e88',uuid=1cf349d6-c215-44b0-a72e-cbc49d925aa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converting VIF {"id": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "address": "fa:16:3e:9b:cc:43", "network": {"id": "cc8c5ee8-a883-4c5a-adb1-ea8acd15be65", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1994210939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf3c986433242a78b50d0ea6ce06200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape05beeaa-cf", "ovs_interfaceid": "e05beeaa-cf6b-4c10-b339-9447bae8fde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG os_vif [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape05beeaa-cf, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32c79c46-3d7d-40a3-a12a-2a9c775f3092) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:05:51 user nova-compute[75279]: INFO os_vif [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:cc:43,bridge_name='br-int',has_traffic_filtering=True,id=e05beeaa-cf6b-4c10-b339-9447bae8fde8,network=Network(cc8c5ee8-a883-4c5a-adb1-ea8acd15be65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape05beeaa-cf')
Nov 11 00:05:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Deleting instance files /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4_del
Nov 11 00:05:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Deletion of /opt/stack/data/nova/instances/1cf349d6-c215-44b0-a72e-cbc49d925aa4_del complete
Nov 11 00:05:51 user nova-compute[75279]: INFO nova.compute.manager [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 11 00:05:51 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:05:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-91b1a3b5-a6ca-41ea-a6e6-ba5f9a6ede05 req-63a3a560-4e45-441a-91e4-c8af57a3ff8a service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-deleted-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:52 user nova-compute[75279]: INFO nova.compute.manager [req-91b1a3b5-a6ca-41ea-a6e6-ba5f9a6ede05 req-63a3a560-4e45-441a-91e4-c8af57a3ff8a service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Neutron deleted interface e05beeaa-cf6b-4c10-b339-9447bae8fde8; detaching it from the instance and deleting it from the info cache
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-91b1a3b5-a6ca-41ea-a6e6-ba5f9a6ede05 req-63a3a560-4e45-441a-91e4-c8af57a3ff8a service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:05:52 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Took 1.06 seconds to deallocate network for instance.
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-91b1a3b5-a6ca-41ea-a6e6-ba5f9a6ede05 req-63a3a560-4e45-441a-91e4-c8af57a3ff8a service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Detach interface failed, port_id=e05beeaa-cf6b-4c10-b339-9447bae8fde8, reason: Instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] Acquiring lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] No waiting events found dispatching network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:05:52 user nova-compute[75279]: WARNING nova.compute.manager [req-b0acab33-1b36-4b15-86b4-7faaeb851dda req-7e81bbb4-5865-42fd-9f91-82f255c88b1e service nova] [instance: 1cf349d6-c215-44b0-a72e-cbc49d925aa4] Received unexpected event network-vif-plugged-e05beeaa-cf6b-4c10-b339-9447bae8fde8 for instance with vm_state deleted and task_state None.
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:05:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:53 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Deleted allocations for instance 1cf349d6-c215-44b0-a72e-cbc49d925aa4
Nov 11 00:05:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-530876d0-0fc1-4c4d-8e1d-f76bc66d1f8c tempest-TestVolumeSwap-1809782791 tempest-TestVolumeSwap-1809782791-project-member] Lock "1cf349d6-c215-44b0-a72e-cbc49d925aa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:05:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:05:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:06:07 user nova-compute[75279]: INFO nova.compute.claims [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Claim successful on node user
Nov 11 00:06:07 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:06:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.policy [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1203d275ebd34ce1a5840ca4b34f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683d6ebfe4794b67b6ec49ce83a46745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:06:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Creating image(s)
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk 1073741824" returned: 0 in 0.059s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Successfully created port: b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Cannot resize image /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Ensure instance console log exists: /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Successfully updated port: b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquired lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-changed-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Refreshing instance network info cache due to event network-changed-b9e08345-100c-4075-a847-c73c1d8a3c85. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] Acquiring lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:06:10 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Releasing lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Instance network_info: |[{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] Acquired lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Refreshing network info cache for port b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Start _get_guest_xml network_info=[{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:06:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1802379478',display_name='tempest-AttachVolumeNegativeTest-server-1802379478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1802379478',id=15,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2aroIfjaXYkQK42vG6vZnyDF+fK0sxOCXSXBmZqpSpiMiOHx3RNvQsZ2GFc1NvTLJXuf8NK+tCzs2JVXWjhtdDNuzCnEvfeS3q/NBqAsJiGsb31XyUYpf3oNXv+NAfVg==',key_name='tempest-keypair-79256428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-p5p1dx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=cf144ba3-c7c9-4a61-91a5-4d463262af48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'pci_devices' on Instance uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:06:11 user nova-compute[75279]:   <uuid>cf144ba3-c7c9-4a61-91a5-4d463262af48</uuid>
Nov 11 00:06:11 user nova-compute[75279]:   <name>instance-0000000f</name>
Nov 11 00:06:11 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:06:11 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:06:11 user nova-compute[75279]:   <metadata>
Nov 11 00:06:11 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:06:11 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1802379478</nova:name>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:06:11</nova:creationTime>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:06:11 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:06:11 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:owner>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:user uuid="1203d275ebd34ce1a5840ca4b34f2754">tempest-AttachVolumeNegativeTest-1189596006-project-member</nova:user>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:project uuid="683d6ebfe4794b67b6ec49ce83a46745">tempest-AttachVolumeNegativeTest-1189596006</nova:project>
Nov 11 00:06:11 user nova-compute[75279]:       </nova:owner>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:06:11 user nova-compute[75279]:       <nova:ports>
Nov 11 00:06:11 user nova-compute[75279]:         <nova:port uuid="b9e08345-100c-4075-a847-c73c1d8a3c85">
Nov 11 00:06:11 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:06:11 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:11 user nova-compute[75279]:       </nova:ports>
Nov 11 00:06:11 user nova-compute[75279]:     </nova:instance>
Nov 11 00:06:11 user nova-compute[75279]:   </metadata>
Nov 11 00:06:11 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:06:11 user nova-compute[75279]:     <system>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="serial">cf144ba3-c7c9-4a61-91a5-4d463262af48</entry>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="uuid">cf144ba3-c7c9-4a61-91a5-4d463262af48</entry>
Nov 11 00:06:11 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:06:11 user nova-compute[75279]:     </system>
Nov 11 00:06:11 user nova-compute[75279]:   </sysinfo>
Nov 11 00:06:11 user nova-compute[75279]:   <os>
Nov 11 00:06:11 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:06:11 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:06:11 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:06:11 user nova-compute[75279]:   </os>
Nov 11 00:06:11 user nova-compute[75279]:   <features>
Nov 11 00:06:11 user nova-compute[75279]:     <acpi/>
Nov 11 00:06:11 user nova-compute[75279]:     <apic/>
Nov 11 00:06:11 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:06:11 user nova-compute[75279]:   </features>
Nov 11 00:06:11 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:06:11 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:06:11 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:06:11 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:06:11 user nova-compute[75279]:   </clock>
Nov 11 00:06:11 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:06:11 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:06:11 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:06:11 user nova-compute[75279]:   </cpu>
Nov 11 00:06:11 user nova-compute[75279]:   <devices>
Nov 11 00:06:11 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:06:11 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:06:11 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk"/>
Nov 11 00:06:11 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:06:11 user nova-compute[75279]:     </disk>
Nov 11 00:06:11 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:11 user nova-compute[75279]:       <mac address="fa:16:3e:dd:86:c2"/>
Nov 11 00:06:11 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:11 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:11 user nova-compute[75279]:       <target dev="tapb9e08345-10"/>
Nov 11 00:06:11 user nova-compute[75279]:     </interface>
Nov 11 00:06:11 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:06:11 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/console.log" append="off"/>
Nov 11 00:06:11 user nova-compute[75279]:     </serial>
Nov 11 00:06:11 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:06:11 user nova-compute[75279]:     <video>
Nov 11 00:06:11 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:11 user nova-compute[75279]:     </video>
Nov 11 00:06:11 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:06:11 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:06:11 user nova-compute[75279]:     </rng>
Nov 11 00:06:11 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:06:11 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:06:11 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:06:11 user nova-compute[75279]:     </memballoon>
Nov 11 00:06:11 user nova-compute[75279]:   </devices>
Nov 11 00:06:11 user nova-compute[75279]: </domain>
Nov 11 00:06:11 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1802379478',display_name='tempest-AttachVolumeNegativeTest-server-1802379478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1802379478',id=15,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2aroIfjaXYkQK42vG6vZnyDF+fK0sxOCXSXBmZqpSpiMiOHx3RNvQsZ2GFc1NvTLJXuf8NK+tCzs2JVXWjhtdDNuzCnEvfeS3q/NBqAsJiGsb31XyUYpf3oNXv+NAfVg==',key_name='tempest-keypair-79256428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-p5p1dx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=cf144ba3-c7c9-4a61-91a5-4d463262af48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG os_vif [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b4fb407-0f88-59ea-9a17-7d48d3057b47', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9e08345-10, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9e08345-10, col_values=(('qos', UUID('074ee793-370e-4856-aea8-67901c33af8f')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9e08345-10, col_values=(('external_ids', {'iface-id': 'b9e08345-100c-4075-a847-c73c1d8a3c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:86:c2', 'vm-uuid': 'cf144ba3-c7c9-4a61-91a5-4d463262af48'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:11 user nova-compute[75279]: WARNING nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] While synchronizing instance power states, found 10 instances in the database and 8 instances on the hypervisor.
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 9e720d48-0c0f-4fe6-b778-e5568e97eabf {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 1a4b49b1-6c6d-45fa-b071-fd762d25576d {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid b91246a8-5138-4044-bad2-4a8251b10b35 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: INFO os_vif [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10')
Nov 11 00:06:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:dd:86:c2, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:06:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updated VIF entry in instance network info cache for port b9e08345-100c-4075-a847-c73c1d8a3c85. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:06:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:06:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef1e3969-f4e3-4ff3-ac17-163bf2de76c9 req-16f425f0-f864-415a-9549-f821d2471499 service nova] Releasing lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:06:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] No waiting events found dispatching network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:13 user nova-compute[75279]: WARNING nova.compute.manager [req-f251a42b-9d91-4551-8e7b-49af8d228b44 req-3becb9ab-029e-4930-b4a6-1a8f29474630 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received unexpected event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 for instance with vm_state building and task_state spawning.
Nov 11 00:06:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:06:14 user nova-compute[75279]: INFO nova.compute.claims [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Claim successful on node user
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:06:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:06:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.policy [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223cf2dd1ecd4a12a5db181391692422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5707b16ebb6042e08f11590de3c92bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:06:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Creating image(s)
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.221s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Successfully created port: a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk 1073741824" returned: 0 in 0.059s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:06:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Instance spawned successfully.
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] No waiting events found dispatching network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:15 user nova-compute[75279]: WARNING nova.compute.manager [req-08e7ecf9-afde-40cc-8b5f-19c482015e83 req-11d188c5-e25d-47c7-8dfd-47b79880ea95 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received unexpected event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 for instance with vm_state building and task_state spawning.
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:06:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:15 user nova-compute[75279]: INFO nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 11 00:06:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Cannot resize image /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Ensure instance console log exists: /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:16 user nova-compute[75279]: INFO nova.compute.manager [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Took 8.58 seconds to build instance.
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-570f22be-1c8f-4b37-ba08-b91fd6870c0a tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.727s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.558s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:16 user nova-compute[75279]: INFO nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Successfully updated port: a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-changed-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Refreshing instance network info cache due to event network-changed-a388b4c3-2b82-4f31-98e3-1765fd0c79e4. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] Acquiring lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:06:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Instance network_info: |[{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] Acquired lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Refreshing network info cache for port a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Start _get_guest_xml network_info=[{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:06:17 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:17 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16073207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16073207',id=16,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ninscn6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:15Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a1af67ad-6a4c-48d7-bbe7-9223db2a5f39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:06:17 user nova-compute[75279]:   <uuid>a1af67ad-6a4c-48d7-bbe7-9223db2a5f39</uuid>
Nov 11 00:06:17 user nova-compute[75279]:   <name>instance-00000010</name>
Nov 11 00:06:17 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:06:17 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:06:17 user nova-compute[75279]:   <metadata>
Nov 11 00:06:17 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:06:17 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-16073207</nova:name>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:06:17</nova:creationTime>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:06:17 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:06:17 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:owner>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:06:17 user nova-compute[75279]:       </nova:owner>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:06:17 user nova-compute[75279]:       <nova:ports>
Nov 11 00:06:17 user nova-compute[75279]:         <nova:port uuid="a388b4c3-2b82-4f31-98e3-1765fd0c79e4">
Nov 11 00:06:17 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 00:06:17 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:17 user nova-compute[75279]:       </nova:ports>
Nov 11 00:06:17 user nova-compute[75279]:     </nova:instance>
Nov 11 00:06:17 user nova-compute[75279]:   </metadata>
Nov 11 00:06:17 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:06:17 user nova-compute[75279]:     <system>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="serial">a1af67ad-6a4c-48d7-bbe7-9223db2a5f39</entry>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="uuid">a1af67ad-6a4c-48d7-bbe7-9223db2a5f39</entry>
Nov 11 00:06:17 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:06:17 user nova-compute[75279]:     </system>
Nov 11 00:06:17 user nova-compute[75279]:   </sysinfo>
Nov 11 00:06:17 user nova-compute[75279]:   <os>
Nov 11 00:06:17 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:06:17 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:06:17 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:06:17 user nova-compute[75279]:   </os>
Nov 11 00:06:17 user nova-compute[75279]:   <features>
Nov 11 00:06:17 user nova-compute[75279]:     <acpi/>
Nov 11 00:06:17 user nova-compute[75279]:     <apic/>
Nov 11 00:06:17 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:06:17 user nova-compute[75279]:   </features>
Nov 11 00:06:17 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:06:17 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:06:17 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:06:17 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:06:17 user nova-compute[75279]:   </clock>
Nov 11 00:06:17 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:06:17 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:06:17 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:06:17 user nova-compute[75279]:   </cpu>
Nov 11 00:06:17 user nova-compute[75279]:   <devices>
Nov 11 00:06:17 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:06:17 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:06:17 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk"/>
Nov 11 00:06:17 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:06:17 user nova-compute[75279]:     </disk>
Nov 11 00:06:17 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:17 user nova-compute[75279]:       <mac address="fa:16:3e:26:a0:a9"/>
Nov 11 00:06:17 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:17 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:17 user nova-compute[75279]:       <target dev="tapa388b4c3-2b"/>
Nov 11 00:06:17 user nova-compute[75279]:     </interface>
Nov 11 00:06:17 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:06:17 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/console.log" append="off"/>
Nov 11 00:06:17 user nova-compute[75279]:     </serial>
Nov 11 00:06:17 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:06:17 user nova-compute[75279]:     <video>
Nov 11 00:06:17 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:17 user nova-compute[75279]:     </video>
Nov 11 00:06:17 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:06:17 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:06:17 user nova-compute[75279]:     </rng>
Nov 11 00:06:17 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:06:17 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:06:17 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:06:17 user nova-compute[75279]:     </memballoon>
Nov 11 00:06:17 user nova-compute[75279]:   </devices>
Nov 11 00:06:17 user nova-compute[75279]: </domain>
Nov 11 00:06:17 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16073207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16073207',id=16,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ninscn6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:15Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a1af67ad-6a4c-48d7-bbe7-9223db2a5f39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG os_vif [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '094471a3-c074-584f-9855-5c97215326c0', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa388b4c3-2b, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa388b4c3-2b, col_values=(('qos', UUID('8c8e99fc-ff76-4963-adaf-98efabc43f6c')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa388b4c3-2b, col_values=(('external_ids', {'iface-id': 'a388b4c3-2b82-4f31-98e3-1765fd0c79e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a0:a9', 'vm-uuid': 'a1af67ad-6a4c-48d7-bbe7-9223db2a5f39'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:17 user nova-compute[75279]: INFO os_vif [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b')
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:26:a0:a9, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updated VIF entry in instance network info cache for port a388b4c3-2b82-4f31-98e3-1765fd0c79e4. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:06:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fda11295-b989-4f3b-8dab-7279dd946a79 req-76b14fc1-a3ee-47e9-8c21-5cdf72175eef service nova] Releasing lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:06:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG nova.compute.manager [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] No waiting events found dispatching network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:19 user nova-compute[75279]: WARNING nova.compute.manager [req-b75b7dbe-9680-47da-945a-b2fc4e163515 req-94cfe5a8-5c8a-4eed-9927-ba3b26263029 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received unexpected event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 for instance with vm_state building and task_state spawning.
Nov 11 00:06:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] No waiting events found dispatching network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:21 user nova-compute[75279]: WARNING nova.compute.manager [req-4383040e-db4e-4752-804d-ce6fc88dfdd8 req-86002d62-3552-4f21-bb7d-1cca0245347b service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received unexpected event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 for instance with vm_state building and task_state spawning.
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:06:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Instance spawned successfully.
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:21 user nova-compute[75279]: INFO nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 11 00:06:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:06:21 user nova-compute[75279]: INFO nova.compute.manager [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Took 7.35 seconds to build instance.
Nov 11 00:06:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c3c85bf8-e46e-420c-9708-6c5d2ae15c88 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.489s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:06:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:28 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:28 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.508567810058594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 08466565-73c2-45cb-abe4-c358c1cc8d36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b91246a8-5138-4044-bad2-4a8251b10b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:06:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:06:29 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:06:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:06:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:06:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.901s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:06:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Creating image(s)
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Ensure instance console log exists: /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Start _get_guest_xml network_info=[{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztJpWBRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a4b49b1-6c6d-45fa-b071-fd762d25576d', 'attached_at': '', 'detached_at': '', 'volume_id': '7cf12de8-3b0e-4a79-b066-413cc1172e40', 'serial': '7cf12de8-3b0e-4a79-b066-413cc1172e40'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '4696f168-dae9-488c-b13d-1ed4fa79fc40', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VomkUXJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a4b49b1-6c6d-45fa-b071-fd762d25576d', 'attached_at': '', 'detached_at': '', 'volume_id': '9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 'serial': '9705c83f-fa20-4e11-9af7-99c81b7f5ba2'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': '87f1dcaf-5696-458e-ae85-1560aa644868', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmMVpCuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a4b49b1-6c6d-45fa-b071-fd762d25576d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c232897b-cdf8-478e-8040-20043092ad67', 'serial': 'c232897b-cdf8-478e-8040-20043092ad67'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': '8be1725f-4598-4413-a1d8-d864ff3618ce', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:06:30 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:30 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztJpWBRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:30 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:30 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:30 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b0c475-6e06-4395-9f4c-a14b27d4862f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:06:30 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:30 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f68afe-3fe9-4564-9386-7d6f30b2c7bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40] added
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464ce37-78cc-4223-9f28-ae663076c84e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f74f2-7418-4cb8-9b07-ef1f5cad86e4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztJpWBRg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztJpWBRg" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c93ed3d-3c3a-4eaa-a38b-1dc0895771f1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztJpWBRg'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63fd525-98bd-4ab3-8243-0b3152b67943]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc45906c-ddff-485c-b5ef-c4182b81e34c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd8c70-1a26-4d3b-b208-7f5de9929437]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260]
Nov 11 00:06:31 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260] successful.
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2210f86a-2739-4be0-8733-de0611092bdb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fec213-b76b-4184-84c6-745389915ae3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:31 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:31 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:31 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c53ea2-36e2-4569-b0e7-d390c39669c4]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:06:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztJpWBRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26636663666306561', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663666306561', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VomkUXJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:32 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:32 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:32 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd9e20-9064-4417-a6f8-826f66fcbb78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:06:32 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071b282-972d-4ea4-82be-8c50230cd120]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2] added
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7882ad91-06f9-4393-952a-1285b32ec325]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee05793-74ca-43d5-8479-13c40b724888]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VomkUXJY {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VomkUXJY" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c19f810-4437-4b55-acb5-5fe61510d814]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VomkUXJY'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cece3b9-1f24-4f72-a887-d2c06d2cd359]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[65947d53-ee00-4025-b298-e1854cf74765]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a153e7a4-199d-4542-aefc-246dbed997f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260]
Nov 11 00:06:32 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260] successful.
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6941f8c-7a54-4aae-a39e-5893438a532c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2b835e-bad6-45d5-a8ed-e18e5dad8f5e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:32 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[541018ba-30f7-4cc7-8d69-91edec245f04]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:32 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VomkUXJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26633333762326539', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633333762326539', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmMVpCuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:33 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:33 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:33 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[86daf150-9b3c-41a2-a59b-d97858302370]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:06:33 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93a7c0-42bc-4e9e-bfea-1543b6509ada]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67] added
Nov 11 00:06:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[975920e6-eee6-4499-a088-8e4074ebd97e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17dfaa-819f-4688-9043-8318a5457560]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmMVpCuc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmMVpCuc" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0bcc78-9d3b-4cfa-9be9-3d84050d9e9d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmMVpCuc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14478882-74f1-4ba6-be98-4af7d2210673]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[514120be-9378-492f-903d-221044e12d03]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:33 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:33 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:33 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:33 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb889a-14f0-4741-a8f2-be48b2d45d04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260]
Nov 11 00:06:33 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260] successful.
Nov 11 00:06:33 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c3dda-4e75-46e7-9141-2499a373a74b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e54035a-89e0-4f43-a5ae-f5cc3b9acd83]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a7a65-5ff3-46ad-a52d-6226fd630c66]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmMVpCuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23030343739313665', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030343739313665', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a4b49b1-6c6d-45fa-b071-fd762d25576d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:06:35 user nova-compute[75279]:   <uuid>1a4b49b1-6c6d-45fa-b071-fd762d25576d</uuid>
Nov 11 00:06:35 user nova-compute[75279]:   <name>instance-0000000b</name>
Nov 11 00:06:35 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:06:35 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:06:35 user nova-compute[75279]:   <metadata>
Nov 11 00:06:35 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:06:35 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:name>tempest-device-tagging-server-2065014828</nova:name>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:06:30</nova:creationTime>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:06:35 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:06:35 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:owner>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:user uuid="6072d84305c64a98be186846f89223cf">tempest-TaggedBootDevicesTest-1521019086-project-member</nova:user>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:project uuid="4f05cbad1a8e42c5b0d5dce7c63abd46">tempest-TaggedBootDevicesTest-1521019086</nova:project>
Nov 11 00:06:35 user nova-compute[75279]:       </nova:owner>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:06:35 user nova-compute[75279]:       <nova:ports>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="75defb01-843d-43f7-b141-fa19ff74f1d0">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="154182d5-5249-426a-b97b-9e881a2b4175">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="9a704e39-3eea-4e9d-8d3c-be16d31b7ed2">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="3db542a4-ed25-415a-bf6d-5ca28f13d650">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="7795e6b9-e3ef-452b-820b-0490c433e372">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="84c913b6-160d-4666-b821-8c9378cb7168">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:         <nova:port uuid="d9f7afa7-60a2-448b-933b-c5596ebcf9b5">
Nov 11 00:06:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 11 00:06:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:06:35 user nova-compute[75279]:       </nova:ports>
Nov 11 00:06:35 user nova-compute[75279]:     </nova:instance>
Nov 11 00:06:35 user nova-compute[75279]:   </metadata>
Nov 11 00:06:35 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:06:35 user nova-compute[75279]:     <system>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="serial">1a4b49b1-6c6d-45fa-b071-fd762d25576d</entry>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="uuid">1a4b49b1-6c6d-45fa-b071-fd762d25576d</entry>
Nov 11 00:06:35 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:06:35 user nova-compute[75279]:     </system>
Nov 11 00:06:35 user nova-compute[75279]:   </sysinfo>
Nov 11 00:06:35 user nova-compute[75279]:   <os>
Nov 11 00:06:35 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:06:35 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:06:35 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:06:35 user nova-compute[75279]:   </os>
Nov 11 00:06:35 user nova-compute[75279]:   <features>
Nov 11 00:06:35 user nova-compute[75279]:     <acpi/>
Nov 11 00:06:35 user nova-compute[75279]:     <apic/>
Nov 11 00:06:35 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:06:35 user nova-compute[75279]:   </features>
Nov 11 00:06:35 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:06:35 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:06:35 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:06:35 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:06:35 user nova-compute[75279]:   </clock>
Nov 11 00:06:35 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:06:35 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:06:35 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:06:35 user nova-compute[75279]:   </cpu>
Nov 11 00:06:35 user nova-compute[75279]:   <devices>
Nov 11 00:06:35 user nova-compute[75279]:     <disk type="file" device="cdrom">
Nov 11 00:06:35 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 00:06:35 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/disk.config"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="hda" bus="ide"/>
Nov 11 00:06:35 user nova-compute[75279]:     </disk>
Nov 11 00:06:35 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:06:35 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:35 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <serial>7cf12de8-3b0e-4a79-b066-413cc1172e40</serial>
Nov 11 00:06:35 user nova-compute[75279]:     </disk>
Nov 11 00:06:35 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:06:35 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:35 user nova-compute[75279]:       <source dev="/dev/sdd"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <serial>9705c83f-fa20-4e11-9af7-99c81b7f5ba2</serial>
Nov 11 00:06:35 user nova-compute[75279]:     </disk>
Nov 11 00:06:35 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:06:35 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:35 user nova-compute[75279]:       <source dev="/dev/sde"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="vdc" bus="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <serial>c232897b-cdf8-478e-8040-20043092ad67</serial>
Nov 11 00:06:35 user nova-compute[75279]:     </disk>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:d4:22:c5"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap75defb01-84"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:67:2c:73"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap154182d5-52"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:cb:74:aa"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap9a704e39-3e"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:07:e7:24"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap3db542a4-ed"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:ae:ba:06"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap7795e6b9-e3"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:0e:f3:e2"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tap84c913b6-16"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:06:35 user nova-compute[75279]:       <mac address="fa:16:3e:c9:30:15"/>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:06:35 user nova-compute[75279]:       <target dev="tapd9f7afa7-60"/>
Nov 11 00:06:35 user nova-compute[75279]:     </interface>
Nov 11 00:06:35 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:06:35 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/console.log" append="off"/>
Nov 11 00:06:35 user nova-compute[75279]:     </serial>
Nov 11 00:06:35 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:06:35 user nova-compute[75279]:     <video>
Nov 11 00:06:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:06:35 user nova-compute[75279]:     </video>
Nov 11 00:06:35 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:06:35 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:06:35 user nova-compute[75279]:     </rng>
Nov 11 00:06:35 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:06:35 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:06:35 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:06:35 user nova-compute[75279]:     </memballoon>
Nov 11 00:06:35 user nova-compute[75279]:   </devices>
Nov 11 00:06:35 user nova-compute[75279]: </domain>
Nov 11 00:06:35 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bd038ec-1573-5fdb-8abd-3a182af78cba', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75defb01-84, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75defb01-84, col_values=(('qos', UUID('d789e311-8485-4aeb-ad5e-3f6651fa9448')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75defb01-84, col_values=(('external_ids', {'iface-id': '75defb01-843d-43f7-b141-fa19ff74f1d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:22:c5', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1145d4b-0ad5-56e4-bddb-dca473ba9619', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap154182d5-52, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap154182d5-52, col_values=(('qos', UUID('15d6f207-cbde-4ed3-9eb4-03e3448aba2b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap154182d5-52, col_values=(('external_ids', {'iface-id': '154182d5-5249-426a-b97b-9e881a2b4175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:2c:73', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '643821db-700f-5ee4-8341-523c31e2f199', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a704e39-3e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a704e39-3e, col_values=(('qos', UUID('6c10240a-4f7d-4729-bf36-59fdcc87a6c1')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a704e39-3e, col_values=(('external_ids', {'iface-id': '9a704e39-3eea-4e9d-8d3c-be16d31b7ed2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:74:aa', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ce7e14c-e3ed-50ac-8958-0b8bb1aa4605', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3db542a4-ed, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3db542a4-ed, col_values=(('qos', UUID('f48615eb-ff00-4a4c-b559-0480b5c31aad')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3db542a4-ed, col_values=(('external_ids', {'iface-id': '3db542a4-ed25-415a-bf6d-5ca28f13d650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:e7:24', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf90f81c-cf88-555b-a9ab-e9d0d5a47a36', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7795e6b9-e3, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7795e6b9-e3, col_values=(('qos', UUID('314eb027-3801-43b8-ac02-e5576f22ad52')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7795e6b9-e3, col_values=(('external_ids', {'iface-id': '7795e6b9-e3ef-452b-820b-0490c433e372', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ba:06', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a22f3f40-218b-50a4-8597-fad099569647', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c913b6-16, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c913b6-16, col_values=(('qos', UUID('d35731f4-e544-4ec2-82fd-47e72b855467')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c913b6-16, col_values=(('external_ids', {'iface-id': '84c913b6-160d-4666-b821-8c9378cb7168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:f3:e2', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd11417a3-9498-5196-8c76-d671db5b2a5c', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9f7afa7-60, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9f7afa7-60, col_values=(('qos', UUID('78e697f8-95ee-4316-b9bf-b7d1131b4f28')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9f7afa7-60, col_values=(('external_ids', {'iface-id': 'd9f7afa7-60a2-448b-933b-c5596ebcf9b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:30:15', 'vm-uuid': '1a4b49b1-6c6d-45fa-b071-fd762d25576d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:35 user nova-compute[75279]: INFO os_vif [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60')
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] No BDM found with device name hda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] No VIF found with MAC fa:16:3e:d4:22:c5, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:06:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] No VIF found with MAC fa:16:3e:ae:ba:06, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:06:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Using config drive
Nov 11 00:06:36 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Creating config drive at /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/disk.config
Nov 11 00:06:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph1zf54xs {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph1zf54xs" returned: 0 in 0.062s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:37 user nova-compute[75279]: WARNING nova.compute.manager [req-c51c5d15-7629-4142-b8ff-967eb7367427 req-7c29c5ec-ec02-4dbd-bb29-f997a9a8c96c service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 for instance with vm_state building and task_state spawning.
Nov 11 00:06:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:38 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:38 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:38 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b836c7-1fbf-43b1-8c01-774908074d46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:06:38 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54a4b3-4bf3-444b-aac5-a60408fcc7a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c] added
Nov 11 00:06:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b359c57-8f82-4b39-b696-aaf1f5e2b396]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae9e100-5fc8-4de5-b10d-0a3c5ba28d9d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLUpQGS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLUpQGS" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce192007-1ad6-43d5-a04e-bf8eb152caeb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shLUpQGS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ee094-09ea-49e0-9bf9-82f316af1e2e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce009c-fd3c-4d8d-acc4-13af8ae27662]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0d575c-f3ba-453d-b164-16895348eb2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]
Nov 11 00:06:39 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.
Nov 11 00:06:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[626079d1-4153-4dd9-bdf6-20768c5f05a0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981dfef-93ed-4a06-bdc2-b3524a08a3f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:06:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:39 user nova-compute[75279]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:06:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e74da5-56d7-48aa-a690-1a5404a9ed0e]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 for instance with vm_state building and task_state spawning.
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:39 user nova-compute[75279]: WARNING nova.compute.manager [req-15b90f62-6936-4346-9a19-aa2d136388ec req-a7c6ebb3-89ba-4b0b-a5c7-49f8b38ce593 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 for instance with vm_state building and task_state spawning.
Nov 11 00:06:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23662643933386537', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643933386537', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG nova.objects.instance [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'flavor' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:06:40 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:40 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:06:40 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:06:40 user nova-compute[75279]:   <serial>acc6c741-d906-4ead-898d-550c4bb5770c</serial>
Nov 11 00:06:40 user nova-compute[75279]: </disk>
Nov 11 00:06:40 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:35:4e:79, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-33877abf-0e70-46de-b1c9-2651f4ec94e5 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.098s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 29.758s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:42 user nova-compute[75279]: WARNING nova.compute.manager [req-e280787e-23ac-437a-a1ad-60b824050991 req-319f0c5a-0960-45e8-8583-8e8f401706c5 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 for instance with vm_state building and task_state spawning.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:06:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance spawned successfully.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:06:42 user nova-compute[75279]: INFO nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Took 11.77 seconds to spawn the instance on the hypervisor.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:06:42 user nova-compute[75279]: INFO nova.compute.manager [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Rebuilding instance
Nov 11 00:06:42 user nova-compute[75279]: INFO nova.compute.manager [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Took 266.23 seconds to build instance.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d9de990e-c541-412a-817b-b01ad84beab5 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 266.337s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 31.179s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:42 user nova-compute[75279]: INFO nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 11 00:06:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:43 user nova-compute[75279]: WARNING nova.compute.manager [req-3df7da0c-c438-435f-90e8-937e31a64bb5 req-cc0829b6-3dbe-4011-ba07-a44d9eebf093 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state active and task_state rebuilding.
Nov 11 00:06:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance destroyed successfully.
Nov 11 00:06:43 user nova-compute[75279]: INFO nova.compute.manager [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Detaching volume acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:06:43 user nova-compute[75279]: INFO nova.virt.block_device [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attempting to driver detach volume acc6c741-d906-4ead-898d-550c4bb5770c from mountpoint /dev/vdb
Nov 11 00:06:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Attempting to detach device vdb from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:06:43 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:43 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:06:43 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:06:43 user nova-compute[75279]:   <serial>acc6c741-d906-4ead-898d-550c4bb5770c</serial>
Nov 11 00:06:43 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:06:43 user nova-compute[75279]: </disk>
Nov 11 00:06:43 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:06:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully detached device vdb from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the persistent domain config.
Nov 11 00:06:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:43 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6cde9e-349c-4398-97de-0e8b18e725cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:06:43 user nova-compute[75279]: No targets found.
Nov 11 00:06:43 user nova-compute[75279]: iSNS:
Nov 11 00:06:43 user nova-compute[75279]: No targets found.
Nov 11 00:06:43 user nova-compute[75279]: STATIC:
Nov 11 00:06:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2
Nov 11 00:06:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40
Nov 11 00:06:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:06:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:06:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:06:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:43 user nova-compute[75279]: FIRMWARE:
Nov 11 00:06:43 user nova-compute[75279]: No targets found.
Nov 11 00:06:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:06:43 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:06:43 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99186b7-7ddf-4000-8214-630f433dd56f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb0ffbc-f9cd-4d7c-95b5-9ab16890b449]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:06:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:43 user nova-compute[75279]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:06:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0449870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:06:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97684d-b5f5-46af-9b22-cddbb2f695e2]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba927c-3e5a-4592-84b3-bbf5e7f31104]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[31942e9d-142f-434b-9932-7cc9d094135d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a9950-ffd2-4859-bbdd-7f5cf70d37eb]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6707b7b0-3ff7-4e83-871f-bd543218b5bb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[da376682-744d-480e-96f2-6653e159b9b7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]
Nov 11 00:06:44 user nova-compute[75279]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.
Nov 11 00:06:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd21ce-477c-4ccf-88d8-4aa877fcc32b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== disconnect_volume: return (339ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:06:44 user nova-compute[75279]: INFO nova.compute.manager [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Unrescuing
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:06:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:45 user nova-compute[75279]: WARNING nova.compute.manager [req-609c49fd-b524-4b5e-b152-7c04e11eb338 req-64c87ef9-4ed2-4548-8231-f73e3db791e0 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state active and task_state rebuilding.
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.network.neutron [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'flavor' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:06:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance destroyed successfully.
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-ServerActionsTestOtherA-server-1472836083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa26cb0f9-04, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dec43e3c-fb35-4bc7-87b7-e7e35276069a) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: INFO os_vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04')
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:45 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c36842-a5ac-41e7-b70b-1056aa557740]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:06:45 user nova-compute[75279]: No targets found.
Nov 11 00:06:45 user nova-compute[75279]: iSNS:
Nov 11 00:06:45 user nova-compute[75279]: No targets found.
Nov 11 00:06:45 user nova-compute[75279]: STATIC:
Nov 11 00:06:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2
Nov 11 00:06:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40
Nov 11 00:06:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:06:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:06:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:06:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:06:45 user nova-compute[75279]: FIRMWARE:
Nov 11 00:06:45 user nova-compute[75279]: No targets found.
Nov 11 00:06:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:06:45 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:06:45 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91657126-3067-4208-847f-b477ee41a52d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ffbb9-38e3-4a11-8258-b0e60a673430]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:06:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0222710>, {}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Disconnecting from: [] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== disconnect_volume: return (105ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:06:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Deleting instance files /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141_del
Nov 11 00:06:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Deletion of /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141_del complete
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:45 user nova-compute[75279]: WARNING nova.compute.manager [req-530da07d-9748-4e51-87f5-9715916d95df req-8ce90659-6cf1-4105-b93b-08781717acb0 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:06:45 user nova-compute[75279]: INFO nova.virt.block_device [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Booting with volume acc6c741-d906-4ead-898d-550c4bb5770c at /dev/vdb
Nov 11 00:06:45 user nova-compute[75279]: DEBUG os_brick.utils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad6b7e-a0e1-4096-96e5-a23138c4c58f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90397bbc-e18d-4afc-bbe5-16f2887f516d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1e4a5-5e9e-4d9d-98fd-4d2aabc95eeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a2f603-85c3-4e09-9147-98c959ba1e42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:06:46 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:06:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[769480e4-b9a5-4dcd-810f-43995ac88851]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG os_brick.utils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating existing volume attachment record: 1b95b975-5173-4c7c-b6bd-a75cfcefcb66 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance destroyed successfully.
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:47 user nova-compute[75279]: WARNING nova.compute.manager [req-3ebd4fd2-7944-46e1-bf02-feba36d004a9 req-8e21f24d-6826-4716-bbc3-1a398eea976f service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:06:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:49 user nova-compute[75279]: WARNING nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:06:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:06:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:06:49 user nova-compute[75279]: WARNING nova.compute.manager [req-289cfd3e-0b89-45e7-974f-f53793141d60 req-135e26bd-90a7-4ba0-829a-e09ae8f746e2 service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:06:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-da6585e3-8566-4f2d-8b9b-e1baa9a51fd9 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:06:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:06:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:06:54 user nova-compute[75279]: INFO nova.compute.manager [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Detaching volume 01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:06:55 user nova-compute[75279]: INFO nova.virt.block_device [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Attempting to driver detach volume 01ee17bc-b174-402e-a0df-27d2606c5f7b from mountpoint /dev/vdb
Nov 11 00:06:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Attempting to detach device vdb from instance 83af4515-8148-461e-9682-9c5917ad61ea from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:06:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:06:55 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:55 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:06:55 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:06:55 user nova-compute[75279]:   <serial>01ee17bc-b174-402e-a0df-27d2606c5f7b</serial>
Nov 11 00:06:55 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:06:55 user nova-compute[75279]: </disk>
Nov 11 00:06:55 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:06:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully detached device vdb from instance 83af4515-8148-461e-9682-9c5917ad61ea from the persistent domain config.
Nov 11 00:06:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83af4515-8148-461e-9682-9c5917ad61ea from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:06:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:06:55 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:06:55 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:06:55 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:06:55 user nova-compute[75279]:   <serial>01ee17bc-b174-402e-a0df-27d2606c5f7b</serial>
Nov 11 00:06:55 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:06:55 user nova-compute[75279]: </disk>
Nov 11 00:06:55 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:06:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:06:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:06:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:07:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:07:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Creating image(s)
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk 1073741824" returned: 0 in 0.045s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Cannot resize image /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Ensure instance console log exists: /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start _get_guest_xml network_info=[{"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99c2acbf-6e9d-49ee-9a91-d505c7054141', 'attached_at': '', 'detached_at': '', 'volume_id': 'acc6c741-d906-4ead-898d-550c4bb5770c', 'serial': 'acc6c741-d906-4ead-898d-550c4bb5770c'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '1b95b975-5173-4c7c-b6bd-a75cfcefcb66', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:07:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 00:07:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:07:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:07:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:07:15 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:07:15 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83af4515-8148-461e-9682-9c5917ad61ea is timed out.
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully detached device vdb from instance 83af4515-8148-461e-9682-9c5917ad61ea from the live domain config.
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc564f-eb96-4800-9d00-7e4fe3e2288f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:07:15 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.057s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[00567fc2-864f-4c95-889c-0b524d33ee38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c] added
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LenXgINA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:07:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d442976-5ea6-426d-86a1-72d4d5689940]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267b27b-1ff0-4c18-be00-203af289a031]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLUpQGS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shLUpQGS" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4669cee-1609-4adb-8109-d6bb230bf9ab]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shLUpQGS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efdc2a9-489d-41ae-87f5-bb85f1869156]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf1731-2aad-4dea-84b7-d762280a9be5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbed4bbe-23fc-4a8e-a715-c3746af3f4de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]
Nov 11 00:07:15 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[502817ae-ef64-470b-a18e-6d6d1e638092]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79adee6-1778-470c-8873-d8fb7bcc6621]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:15 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fee788-0f96-451c-9ec6-9d3313f831bc]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23662643933386537', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643933386537', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.295s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:07:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-ServerActionsTestOtherA-server-1472836083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:07:17 user nova-compute[75279]:   <uuid>99c2acbf-6e9d-49ee-9a91-d505c7054141</uuid>
Nov 11 00:07:17 user nova-compute[75279]:   <name>instance-0000000c</name>
Nov 11 00:07:17 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:07:17 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:07:17 user nova-compute[75279]:   <metadata>
Nov 11 00:07:17 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:07:17 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherA-server-1472836083</nova:name>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:07:15</nova:creationTime>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:07:17 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:07:17 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:owner>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:user uuid="f5de431660e34578b7ef8b6b7e0577ab">tempest-ServerActionsTestOtherA-191498200-project-member</nova:user>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:project uuid="e56bb9030efe414aa52c4aa97febfd2e">tempest-ServerActionsTestOtherA-191498200</nova:project>
Nov 11 00:07:17 user nova-compute[75279]:       </nova:owner>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:07:17 user nova-compute[75279]:       <nova:ports>
Nov 11 00:07:17 user nova-compute[75279]:         <nova:port uuid="a26cb0f9-0416-4130-919c-550a9fa12a6e">
Nov 11 00:07:17 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:07:17 user nova-compute[75279]:         </nova:port>
Nov 11 00:07:17 user nova-compute[75279]:       </nova:ports>
Nov 11 00:07:17 user nova-compute[75279]:     </nova:instance>
Nov 11 00:07:17 user nova-compute[75279]:   </metadata>
Nov 11 00:07:17 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:07:17 user nova-compute[75279]:     <system>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="serial">99c2acbf-6e9d-49ee-9a91-d505c7054141</entry>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="uuid">99c2acbf-6e9d-49ee-9a91-d505c7054141</entry>
Nov 11 00:07:17 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:07:17 user nova-compute[75279]:     </system>
Nov 11 00:07:17 user nova-compute[75279]:   </sysinfo>
Nov 11 00:07:17 user nova-compute[75279]:   <os>
Nov 11 00:07:17 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:07:17 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:07:17 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:07:17 user nova-compute[75279]:   </os>
Nov 11 00:07:17 user nova-compute[75279]:   <features>
Nov 11 00:07:17 user nova-compute[75279]:     <acpi/>
Nov 11 00:07:17 user nova-compute[75279]:     <apic/>
Nov 11 00:07:17 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:07:17 user nova-compute[75279]:   </features>
Nov 11 00:07:17 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:07:17 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:07:17 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:07:17 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:07:17 user nova-compute[75279]:   </clock>
Nov 11 00:07:17 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:07:17 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:07:17 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:07:17 user nova-compute[75279]:   </cpu>
Nov 11 00:07:17 user nova-compute[75279]:   <devices>
Nov 11 00:07:17 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:07:17 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:07:17 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk"/>
Nov 11 00:07:17 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:07:17 user nova-compute[75279]:     </disk>
Nov 11 00:07:17 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:07:17 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:07:17 user nova-compute[75279]:       <source dev="/dev/sdf"/>
Nov 11 00:07:17 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:07:17 user nova-compute[75279]:       <serial>acc6c741-d906-4ead-898d-550c4bb5770c</serial>
Nov 11 00:07:17 user nova-compute[75279]:     </disk>
Nov 11 00:07:17 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:07:17 user nova-compute[75279]:       <mac address="fa:16:3e:35:4e:79"/>
Nov 11 00:07:17 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:07:17 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:07:17 user nova-compute[75279]:       <target dev="tapa26cb0f9-04"/>
Nov 11 00:07:17 user nova-compute[75279]:     </interface>
Nov 11 00:07:17 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:07:17 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/console.log" append="off"/>
Nov 11 00:07:17 user nova-compute[75279]:     </serial>
Nov 11 00:07:17 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:07:17 user nova-compute[75279]:     <video>
Nov 11 00:07:17 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:07:17 user nova-compute[75279]:     </video>
Nov 11 00:07:17 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:07:17 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:07:17 user nova-compute[75279]:     </rng>
Nov 11 00:07:17 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:07:17 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:07:17 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:07:17 user nova-compute[75279]:     </memballoon>
Nov 11 00:07:17 user nova-compute[75279]:   </devices>
Nov 11 00:07:17 user nova-compute[75279]: </domain>
Nov 11 00:07:17 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-ServerActionsTestOtherA-server-1472836083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559c154-5f13-4fc3-be56-6092233816d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:07:17 user nova-compute[75279]: No targets found.
Nov 11 00:07:17 user nova-compute[75279]: iSNS:
Nov 11 00:07:17 user nova-compute[75279]: No targets found.
Nov 11 00:07:17 user nova-compute[75279]: STATIC:
Nov 11 00:07:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2
Nov 11 00:07:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:07:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:07:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40
Nov 11 00:07:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:07:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:07:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b
Nov 11 00:07:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:07:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:07:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:07:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:07:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:07:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:07:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:07:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:07:17 user nova-compute[75279]: FIRMWARE:
Nov 11 00:07:17 user nova-compute[75279]: No targets found.
Nov 11 00:07:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:07:17 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:07:17 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '760ef483-e615-5c26-ad8d-88cbaed16d0f', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa26cb0f9-04, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa26cb0f9-04, col_values=(('qos', UUID('288023f5-bba6-4ab9-9657-66f6a1e4f0ce')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa26cb0f9-04, col_values=(('external_ids', {'iface-id': 'a26cb0f9-0416-4130-919c-550a9fa12a6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:4e:79', 'vm-uuid': '99c2acbf-6e9d-49ee-9a91-d505c7054141'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[953b0a8a-9293-4db8-883b-4e0953085329]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:17 user nova-compute[75279]: INFO os_vif [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04')
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6817fd06-4ce5-4323-ab86-7e31d7cdd590]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:17 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03c4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc43b0-75a5-4101-bb25-a233fbeca1fd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c404c-7b47-421b-b88b-ae469d08bfe8]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:35:4e:79, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4835d22c-4dd5-4352-a0a1-aa17da1f7ec3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb1068c-dcea-4f77-8c7c-77a3432c0b85]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6e1446-f9df-4213-af2d-1fd974d3d31a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[73113295-5b75-4a83-9c9b-6d5dce1f9241]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260]
Nov 11 00:07:17 user nova-compute[75279]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b, portal: 172.16.0.220,3260] successful.
Nov 11 00:07:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ee17bc-b174-402e-a0df-27d2606c5f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1a8ec-57a1-451b-8f46-d7bf7fd9f5d4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== disconnect_volume: return (1686ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:07:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:18 user nova-compute[75279]: WARNING nova.compute.manager [req-64fe43c9-5393-49ee-80c0-75ec0d8c05bb req-587648bc-6420-4ce2-bff8-7d83b7d63abf service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state active and task_state rebuild_spawning.
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:20 user nova-compute[75279]: WARNING nova.compute.manager [req-04d9c48f-d899-46bf-b2e1-5dd88936831c req-28cac669-5176-4f28-9242-e632dee9ba61 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state active and task_state rebuild_spawning.
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:07:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance spawned successfully.
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75279) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9864c64f-d704-4ae2-895d-2184b49d35b8 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:23 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-changed-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Refreshing instance network info cache due to event network-changed-a747ac01-9d33-4fe7-8189-d8f61b429423. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] Acquiring lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] Acquired lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG nova.network.neutron [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Refreshing network info cache for port a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Ignoring supplied device name: /dev/vdb
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updated VIF entry in instance network info cache for port a747ac01-9d33-4fe7-8189-d8f61b429423. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating instance_info_cache with network_info: [{"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ba95c3ff-17bb-485b-aef4-4622a5b73cca req-22b25895-e6e6-4d2a-ae68-b388df5b90aa service nova] Releasing lock "refresh_cache-08466565-73c2-45cb-abe4-c358c1cc8d36" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:28 user nova-compute[75279]: INFO nova.compute.manager [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Attaching volume 7ecd0446-258d-4b65-a0bc-86e6cedf75e0 to /dev/vdb
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.utils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83023c7b-2a76-4f02-9db7-3680368a88e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409a584-f163-4376-8ed4-2eae9136b9a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770e2f0-9220-442e-8499-d4e394957606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[067db0bb-8361-49c5-9acd-643403e9484e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:07:28 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[822b87c7-fd99-43ce-878a-d192fb4f84b2]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG os_brick.utils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating existing volume attachment record: 131f1bf1-d9a3-441d-bb1e-b153679a6752 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:07:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:07:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7306MB free_disk=25.4654541015625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 08466565-73c2-45cb-abe4-c358c1cc8d36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b91246a8-5138-4044-bad2-4a8251b10b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:07:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:07:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:07:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:42 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:07:42 user nova-compute[75279]: INFO nova.compute.claims [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Claim successful on node user
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:07:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.objects.instance [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.policy [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fe0334c76ab4a77819bb11e42e3ba3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280c69c91fb040f79bd21c7bd89672ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-01f90955-6f49-4bc7-997e-ceb20def86d7 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 48.805s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:43 user nova-compute[75279]: INFO nova.virt.block_device [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Booting with volume b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e at /dev/vda
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.utils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030d970-3ad3-4c86-987a-b185f1b451ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab1f558-8adb-4853-bbcc-ad00e4aa1f18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4a0b1-201d-4e74-a576-9500a02e286b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e6c8c-b987-4602-b8e1-c9b165c4a229]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:07:43 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:07:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d1fdcc-279c-40e7-b2f7-57adfae8c774]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG os_brick.utils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:07:43 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating existing volume attachment record: 1b9ca9dc-4e9f-4563-ac4c-ad5f45e9c373 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75279) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:44 user nova-compute[75279]: WARNING nova.compute.manager [req-ce9e28ce-bd5d-4621-a23e-4be7228c00d0 req-2c281818-1b9a-46ea-8cb6-bea90ca60ee5 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state active and task_state powering-off.
Nov 11 00:07:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Successfully created port: f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance destroyed successfully.
Nov 11 00:07:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a54c0b64-584a-4203-902f-07c2d43e46c4 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.903s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Successfully updated port: f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquired lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:07:45 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating instance_info_cache with network_info: [{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Releasing lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance network_info: |[{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:46 user nova-compute[75279]: WARNING nova.compute.manager [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state None.
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-changed-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Refreshing instance network info cache due to event network-changed-f948b442-834c-45b5-a217-e97f753b968d. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Acquiring lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Acquired lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:07:46 user nova-compute[75279]: DEBUG nova.network.neutron [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Refreshing network info cache for port f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:07:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:47 user nova-compute[75279]: DEBUG nova.network.neutron [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updated VIF entry in instance network info cache for port f948b442-834c-45b5-a217-e97f753b968d. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:07:47 user nova-compute[75279]: DEBUG nova.network.neutron [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating instance_info_cache with network_info: [{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ffeabe16-9325-43ca-a796-7421bc1d04df req-18d3e11d-9e07-4629-a0c9-8d363fd5fb35 service nova] Releasing lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:50 user nova-compute[75279]: INFO nova.compute.manager [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Terminating instance
Nov 11 00:07:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-unplugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] No waiting events found dispatching network-vif-unplugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f7f80e3-9ba7-4085-ad18-f81fb1f86a30 req-2b968880-380a-4e5e-b66b-6c867e4a2ce9 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-unplugged-203d1abf-c657-4878-a147-7c120d67b289 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Instance destroyed successfully.
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'resources' on Instance uuid b91246a8-5138-4044-bad2-4a8251b10b35 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268197490',display_name='tempest-VolumesAdminNegativeTest-server-1268197490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268197490',id=14,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-s4wx6eza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:05:48Z,user_data=None,user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=b91246a8-5138-4044-bad2-4a8251b10b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "203d1abf-c657-4878-a147-7c120d67b289", "address": "fa:16:3e:39:46:24", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203d1abf-c6", "ovs_interfaceid": "203d1abf-c657-4878-a147-7c120d67b289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG os_vif [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203d1abf-c6, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa8e0a58-f2ca-4840-970d-21e65b07125c) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: INFO os_vif [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:46:24,bridge_name='br-int',has_traffic_filtering=True,id=203d1abf-c657-4878-a147-7c120d67b289,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203d1abf-c6')
Nov 11 00:07:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Deleting instance files /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35_del
Nov 11 00:07:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Deletion of /opt/stack/data/nova/instances/b91246a8-5138-4044-bad2-4a8251b10b35_del complete
Nov 11 00:07:51 user nova-compute[75279]: INFO nova.compute.manager [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 11 00:07:51 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:51 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:52 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Took 0.56 seconds to deallocate network for instance.
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-b64aebe0-d028-44ca-bd25-b8e8844aa7b7 req-9de7854b-219e-465b-bc02-2989288632e7 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-deleted-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:52 user nova-compute[75279]: INFO nova.compute.manager [req-b64aebe0-d028-44ca-bd25-b8e8844aa7b7 req-9de7854b-219e-465b-bc02-2989288632e7 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Neutron deleted interface 203d1abf-c657-4878-a147-7c120d67b289; detaching it from the instance and deleting it from the info cache
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-b64aebe0-d028-44ca-bd25-b8e8844aa7b7 req-9de7854b-219e-465b-bc02-2989288632e7 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-b64aebe0-d028-44ca-bd25-b8e8844aa7b7 req-9de7854b-219e-465b-bc02-2989288632e7 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Detach interface failed, port_id=203d1abf-c657-4878-a147-7c120d67b289, reason: Instance b91246a8-5138-4044-bad2-4a8251b10b35 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:52 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Deleted allocations for instance b91246a8-5138-4044-bad2-4a8251b10b35
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0ca311ec-1413-4747-a7b7-1109803dcd86 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "b91246a8-5138-4044-bad2-4a8251b10b35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] Acquiring lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] Lock "b91246a8-5138-4044-bad2-4a8251b10b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] No waiting events found dispatching network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:07:52 user nova-compute[75279]: WARNING nova.compute.manager [req-47fc6f96-cfa3-41c7-97d5-7a7d62e690d7 req-44c88bb6-3583-4b1b-95fd-2688aea0f5c2 service nova] [instance: b91246a8-5138-4044-bad2-4a8251b10b35] Received unexpected event network-vif-plugged-203d1abf-c657-4878-a147-7c120d67b289 for instance with vm_state deleted and task_state None.
Nov 11 00:07:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnimBcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:07:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:07:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:07:56 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0797b4-d2b4-42d6-a254-543428bed23f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:07:56 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d97207-b640-455b-a36a-f9337276b2c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0] added
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[721ad6ed-a903-44e8-940a-2e39a335baad]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3528e965-7731-44cb-a329-c1baf5884392]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnimBcVY {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnimBcVY" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74891432-3f86-49cb-8ecc-e95d31c4835a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnimBcVY'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5eb9c-5127-4dc3-a5a8-9551af33502c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4dc854-ded7-4dfb-bbbf-f12df067536c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e6b404-696b-4a53-92be-c8a92cd75605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260]
Nov 11 00:07:56 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260] successful.
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba91bdd-d1a0-4f73-8c32-6faaeac2d255]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c07a225-5a07-496d-afbd-58febdb95ac9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:07:56 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:07:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbaaab6-c136-458c-98b2-a05caed4c4aa]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:07:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnimBcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:07:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:07:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23439623836633335', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:07:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439623836633335', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:07:58 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:07:58 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:07:58 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:07:58 user nova-compute[75279]:   <serial>7ecd0446-258d-4b65-a0bc-86e6cedf75e0</serial>
Nov 11 00:07:58 user nova-compute[75279]: </disk>
Nov 11 00:07:58 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No VIF found with MAC fa:16:3e:03:84:10, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed10851c-4a13-4bdd-ab74-ea63529b91a6 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.196s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-changed-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Refreshing instance network info cache due to event network-changed-b9e08345-100c-4075-a847-c73c1d8a3c85. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] Acquiring lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] Acquired lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:07:58 user nova-compute[75279]: DEBUG nova.network.neutron [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Refreshing network info cache for port b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:07:59 user nova-compute[75279]: DEBUG nova.network.neutron [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updated VIF entry in instance network info cache for port b9e08345-100c-4075-a847-c73c1d8a3c85. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:07:59 user nova-compute[75279]: DEBUG nova.network.neutron [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:07:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-50ef7101-331f-4380-ad9e-7109f9cede3a req-1ba31751-4ffd-41db-8992-74365a2f201d service nova] Releasing lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:04 user nova-compute[75279]: INFO nova.compute.manager [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Attaching volume e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd to /dev/vdb
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.utils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db8a62-980f-430f-aecc-7dc2eba28b03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d024d6b-8f24-4e3b-b188-42a5216d436d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6019e7c-7305-454f-989f-df685053db8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[62286a89-0843-4c63-8c7d-aba73103a079]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:08:05 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:08:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98a3b1a-8f20-4e9e-89f6-55a20f31142f]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG os_brick.utils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating existing volume attachment record: 8715b974-9d9e-402b-9033-f0f208e70ba2 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:08:05 user nova-compute[75279]: DEBUG nova.compute.manager [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:08:05 user nova-compute[75279]: INFO nova.compute.manager [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] instance snapshotting
Nov 11 00:08:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Beginning live snapshot process
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.213s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7.delta 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7.delta 1073741824" returned: 0 in 0.071s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:06 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 00:08:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:08:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] COPY block job progress, current cursor: 11927552 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:08:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:08:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 00:08:08 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:08:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7.delta /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7.delta /opt/stack/data/nova/instances/snapshots/tmphkn8nf3n/1b72ea6a3de147758b4490dd0b7a11c7" returned: 0 in 0.634s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Snapshot extracted, beginning image upload
Nov 11 00:08:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Snapshot image upload complete
Nov 11 00:08:13 user nova-compute[75279]: INFO nova.compute.manager [None req-26e9c525-451e-4bcd-8841-bceb6e6eae20 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Took 7.36 seconds to snapshot the instance on the hypervisor.
Nov 11 00:08:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-changed-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing instance network info cache due to event network-changed-75defb01-843d-43f7-b141-fa19ff74f1d0. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] Acquiring lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] Acquired lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG nova.network.neutron [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Refreshing network info cache for port 75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:08:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:22 user nova-compute[75279]: DEBUG nova.network.neutron [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updated VIF entry in instance network info cache for port 75defb01-843d-43f7-b141-fa19ff74f1d0. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:08:22 user nova-compute[75279]: DEBUG nova.network.neutron [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ddf49dc-fa23-41ed-861a-9ba099beb513 req-570f1251-b7f8-4291-b403-0f6d1f8b2164 service nova] Releasing lock "refresh_cache-1a4b49b1-6c6d-45fa-b071-fd762d25576d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:24 user nova-compute[75279]: INFO nova.compute.manager [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Terminating instance
Nov 11 00:08:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-b594c96c-5126-4e99-849b-7541d9f05074 req-5a46296c-0a05-4efd-b9ce-d2134b99034e service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-75defb01-843d-43f7-b141-fa19ff74f1d0 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Instance destroyed successfully.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lazy-loading 'resources' on Instance uuid 1a4b49b1-6c6d-45fa-b071-fd762d25576d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75defb01-84, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d789e311-8485-4aeb-ad5e-3f6651fa9448) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:22:c5,bridge_name='br-int',has_traffic_filtering=True,id=75defb01-843d-43f7-b141-fa19ff74f1d0,network=Network(7679e69c-6328-44d1-a4e8-5ab889679796),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75defb01-84')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap154182d5-52, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15d6f207-cbde-4ed3-9eb4-03e3448aba2b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2c:73,bridge_name='br-int',has_traffic_filtering=True,id=154182d5-5249-426a-b97b-9e881a2b4175,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154182d5-52')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a704e39-3e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c10240a-4f7d-4729-bf36-59fdcc87a6c1) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:74:aa,bridge_name='br-int',has_traffic_filtering=True,id=9a704e39-3eea-4e9d-8d3c-be16d31b7ed2,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a704e39-3e')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3db542a4-ed, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f48615eb-ff00-4a4c-b559-0480b5c31aad) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:24,bridge_name='br-int',has_traffic_filtering=True,id=3db542a4-ed25-415a-bf6d-5ca28f13d650,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db542a4-ed')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7795e6b9-e3, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=314eb027-3801-43b8-ac02-e5576f22ad52) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-75defb01-843d-43f7-b141-fa19ff74f1d0 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-154182d5-5249-426a-b97b-9e881a2b4175 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-154182d5-5249-426a-b97b-9e881a2b4175 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-9a704e39-3eea-4e9d-8d3c-be16d31b7ed2 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-3db542a4-ed25-415a-bf6d-5ca28f13d650 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-7795e6b9-e3ef-452b-820b-0490c433e372 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-7795e6b9-e3ef-452b-820b-0490c433e372 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-84c913b6-160d-4666-b821-8c9378cb7168 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:26 user nova-compute[75279]: WARNING nova.compute.manager [req-32f703d6-47e4-4588-b32f-e4287c6c1c53 req-5f20a2d8-a83a-4fb4-afc4-47b1f7331a4f service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-84c913b6-160d-4666-b821-8c9378cb7168 for instance with vm_state active and task_state deleting.
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=7795e6b9-e3ef-452b-820b-0490c433e372,network=Network(9c3af83a-a47a-4d8c-a134-222fa2544492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7795e6b9-e3')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "84c913b6-160d-4666-b821-8c9378cb7168", "address": "fa:16:3e:0e:f3:e2", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c913b6-16", "ovs_interfaceid": "84c913b6-160d-4666-b821-8c9378cb7168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c913b6-16, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d35731f4-e544-4ec2-82fd-47e72b855467) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:26 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f3:e2,bridge_name='br-int',has_traffic_filtering=True,id=84c913b6-160d-4666-b821-8c9378cb7168,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c913b6-16')
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2065014828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2065014828',id=11,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPc9yanQnSque0GXyTTZn1rTYnYBDNZ/2YSE7X8ZAm/exKoLRbW1l6gX34h3g4kxNtPVVdYXUZBQvM+3DZ9t84ss/RQSHAhlfd2BT6lOUdrqaTkaFfwZ/BRqWHjvkKPoQ==',key_name='tempest-keypair-578546882',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f05cbad1a8e42c5b0d5dce7c63abd46',ramdisk_id='',reservation_id='r-0p8komab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1521019086',owner_user_name='tempest-TaggedBootDevicesTest-1521019086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6072d84305c64a98be186846f89223cf',uuid=1a4b49b1-6c6d-45fa-b071-fd762d25576d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converting VIF {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9f7afa7-60, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78e697f8-95ee-4316-b9bf-b7d1131b4f28) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:27 user nova-compute[75279]: INFO os_vif [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:30:15,bridge_name='br-int',has_traffic_filtering=True,id=d9f7afa7-60a2-448b-933b-c5596ebcf9b5,network=Network(f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f7afa7-60')
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztJpWBRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:27 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218fd56-b34e-4d76-b62e-33ca672f2656]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: iSNS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: STATIC:
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: FIRMWARE:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:08:27 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cfbcce-7dc3-4e98-99d6-37af6b0cb73e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d91fa71-b879-4743-9e1d-53067dc108a8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03c5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[36683c7c-d166-44f1-8ae3-061af2606503]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[600de314-0098-409a-bcf3-8fbe1ada4a3e]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c6174-9c62-447d-9573-379ad5bb02de]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89e293-5213-4099-9efc-80a2da171b07]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7253d87b-a500-4f87-baeb-de81c2d0058a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd15824-e4a1-4d90-94e9-d865942d273e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260]
Nov 11 00:08:27 user nova-compute[75279]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40, portal: 172.16.0.220,3260] successful.
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cf12de8-3b0e-4a79-b066-413cc1172e40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b5c48-96f3-4831-aec4-343beaa71428]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== disconnect_volume: return (413ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VomkUXJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:27 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c3e8c0-f812-4e76-ba54-70cb9dec3808]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: iSNS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: STATIC:
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: FIRMWARE:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:08:27 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd78d9e-5ced-4c62-891b-901a3e0e3b0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b5f27-cd0a-4890-a81e-c90d90f0ba15]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:27 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03c6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d9fc8-6b3d-43ff-ab64-87e38eb301b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9d3f0-c640-4a1b-ae43-e2df4c0c6319]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792a6ad-f36a-4160-b2e3-71cb0f202ca6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2cb383-5807-465d-9dbd-f01724a03b6e]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf214db-506f-4669-9496-90b95c2ac2f3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a952f9ff-20e4-48ef-be92-d81159ed8cd1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260]
Nov 11 00:08:27 user nova-compute[75279]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2, portal: 172.16.0.220,3260] successful.
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9705c83f-fa20-4e11-9af7-99c81b7f5ba2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a7f1e-a856-4b66-8b22-808fc6c4b08c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== disconnect_volume: return (389ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmMVpCuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:27 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b04fe-6e97-4464-898c-11943f15c4a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: iSNS:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]: STATIC:
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0
Nov 11 00:08:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:08:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:08:27 user nova-compute[75279]: FIRMWARE:
Nov 11 00:08:27 user nova-compute[75279]: No targets found.
Nov 11 00:08:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:08:27 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:08:27 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0758951-e333-480c-af9e-00b14c19b864]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecc1135-ab93-4119-911f-474bb9a6622d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:28 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:28 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:28 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 (non-flash)
Nov 11 00:08:28 user nova-compute[75279]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:28 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:28 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03ee5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[25690758-c622-4901-a50d-9e3e9e2006de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcade75-4d51-43f6-9605-9e61b50a15d4]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d655dcc-0018-4f43-be27-9224eb81e0a9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b88cc-e953-4661-87a3-e66c258030a0]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e44f0c-17e5-459d-aa86-344adf1ac837]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09949f8-d297-48ba-a6c7-221a3160d6e9]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260]
Nov 11 00:08:28 user nova-compute[75279]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67, portal: 172.16.0.220,3260] successful.
Nov 11 00:08:28 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c232897b-cdf8-478e-8040-20043092ad67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd3fc76-9fd5-4dd1-bf26-8ee4961139a9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] <== disconnect_volume: return (375ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:08:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Deleting instance files /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d_del
Nov 11 00:08:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Deletion of /opt/stack/data/nova/instances/1a4b49b1-6c6d-45fa-b071-fd762d25576d_del complete
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: INFO nova.compute.manager [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Took 4.10 seconds to destroy the instance on the hypervisor.
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-unplugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-unplugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Acquiring lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] No waiting events found dispatching network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:28 user nova-compute[75279]: WARNING nova.compute.manager [req-538db9c1-a892-4176-a99b-e19977d84615 req-336e3b82-c8d9-476e-a922-3f85c1c0d03a service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received unexpected event network-vif-plugged-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 for instance with vm_state active and task_state deleting.
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:08:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Creating image(s)
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Ensure instance console log exists: /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start _get_guest_xml network_info=[{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '508cd740-432b-433c-803f-da3892a04d48', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'serial': 'b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1b9ca9dc-4e9f-4563-ac4c-ad5f45e9c373', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:08:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:29 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7b9f3-50ee-4a92-b9a6-16e5d7147cf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:08:29 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc9839-7025-466f-aecd-b7a4fb400337]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e] added
Nov 11 00:08:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90508f8f-a58e-4106-a52c-9127e324c32f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268b1db-6c66-43e3-a925-3e0bc77d2319]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVAcJKBN {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVAcJKBN" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08849b6f-73aa-4fcd-92df-5be01078f78e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVAcJKBN'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc731ea-12bd-4181-a0b9-717f5867c2c1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4d356-2f34-44cc-9c87-be960089b6e8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:29 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:29 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff833190-9c36-4948-ad94-7b9f2433893e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]
Nov 11 00:08:29 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.
Nov 11 00:08:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e46442-aca4-474b-a8d3-e3e7a18ccb48]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff96b269-2a57-40de-bcc4-9c959bb1fbb4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:30 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:30 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:30 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:30 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:30 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:30 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b745cf4-036f-453f-a665-35ffccac0f1b]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '1a4b49b1-6c6d-45fa-b071-fd762d25576d' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '1a4b49b1-6c6d-45fa-b071-fd762d25576d' (instance-0000000b)
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-59074c83-9eeb-4fc4-a4be-b1a9d1c5b220 req-289fd331-6af2-4e87-b266-c1b9068e6692 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-deleted-84c913b6-160d-4666-b821-8c9378cb7168 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:30 user nova-compute[75279]: INFO nova.compute.manager [req-59074c83-9eeb-4fc4-a4be-b1a9d1c5b220 req-289fd331-6af2-4e87-b266-c1b9068e6692 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Neutron deleted interface 84c913b6-160d-4666-b821-8c9378cb7168; detaching it from the instance and deleting it from the info cache
Nov 11 00:08:30 user nova-compute[75279]: DEBUG nova.network.neutron [req-59074c83-9eeb-4fc4-a4be-b1a9d1c5b220 req-289fd331-6af2-4e87-b266-c1b9068e6692 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [{"id": "75defb01-843d-43f7-b141-fa19ff74f1d0", "address": "fa:16:3e:d4:22:c5", "network": {"id": "7679e69c-6328-44d1-a4e8-5ab889679796", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-994078820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75defb01-84", "ovs_interfaceid": "75defb01-843d-43f7-b141-fa19ff74f1d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154182d5-5249-426a-b97b-9e881a2b4175", "address": "fa:16:3e:67:2c:73", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154182d5-52", "ovs_interfaceid": "154182d5-5249-426a-b97b-9e881a2b4175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "address": "fa:16:3e:cb:74:aa", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a704e39-3e", "ovs_interfaceid": "9a704e39-3eea-4e9d-8d3c-be16d31b7ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "address": "fa:16:3e:07:e7:24", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db542a4-ed", "ovs_interfaceid": "3db542a4-ed25-415a-bf6d-5ca28f13d650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7795e6b9-e3ef-452b-820b-0490c433e372", "address": "fa:16:3e:ae:ba:06", "network": {"id": "9c3af83a-a47a-4d8c-a134-222fa2544492", "bridge": "br-int", "label": "tempest-device-tagging-net1-1480093740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7795e6b9-e3", "ovs_interfaceid": "7795e6b9-e3ef-452b-820b-0490c433e372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "address": "fa:16:3e:c9:30:15", "network": {"id": "f9d4d7ab-7e6d-4d6b-9701-adfe702cedf2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1754419697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f05cbad1a8e42c5b0d5dce7c63abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f7afa7-60", "ovs_interfaceid": "d9f7afa7-60a2-448b-933b-c5596ebcf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-59074c83-9eeb-4fc4-a4be-b1a9d1c5b220 req-289fd331-6af2-4e87-b266-c1b9068e6692 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Detach interface failed, port_id=84c913b6-160d-4666-b821-8c9378cb7168, reason: Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.845s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== connect_volume: return (1846ms) {'type': 'block', 'scsi_wwn': '23266343037643864', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266343037643864', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:08:31 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:31 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.4117431640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1721693801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lazy-loading 'pci_devices' on Instance uuid 508cd740-432b-433c-803f-da3892a04d48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:08:31 user nova-compute[75279]:   <uuid>508cd740-432b-433c-803f-da3892a04d48</uuid>
Nov 11 00:08:31 user nova-compute[75279]:   <name>instance-00000011</name>
Nov 11 00:08:31 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:08:31 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:08:31 user nova-compute[75279]:   <metadata>
Nov 11 00:08:31 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:08:31 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:08:31 user nova-compute[75279]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1721693801</nova:name>
Nov 11 00:08:31 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:08:29</nova:creationTime>
Nov 11 00:08:31 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:08:31 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:08:31 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:08:31 user nova-compute[75279]:       <nova:owner>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:user uuid="3fe0334c76ab4a77819bb11e42e3ba3a">tempest-ServerActionsV293TestJSON-1040260601-project-member</nova:user>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:project uuid="280c69c91fb040f79bd21c7bd89672ac">tempest-ServerActionsV293TestJSON-1040260601</nova:project>
Nov 11 00:08:31 user nova-compute[75279]:       </nova:owner>
Nov 11 00:08:31 user nova-compute[75279]:       <nova:ports>
Nov 11 00:08:31 user nova-compute[75279]:         <nova:port uuid="f948b442-834c-45b5-a217-e97f753b968d">
Nov 11 00:08:31 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 00:08:31 user nova-compute[75279]:         </nova:port>
Nov 11 00:08:31 user nova-compute[75279]:       </nova:ports>
Nov 11 00:08:31 user nova-compute[75279]:     </nova:instance>
Nov 11 00:08:31 user nova-compute[75279]:   </metadata>
Nov 11 00:08:31 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:08:31 user nova-compute[75279]:     <system>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="serial">508cd740-432b-433c-803f-da3892a04d48</entry>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="uuid">508cd740-432b-433c-803f-da3892a04d48</entry>
Nov 11 00:08:31 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:08:31 user nova-compute[75279]:     </system>
Nov 11 00:08:31 user nova-compute[75279]:   </sysinfo>
Nov 11 00:08:31 user nova-compute[75279]:   <os>
Nov 11 00:08:31 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:08:31 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:08:31 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:08:31 user nova-compute[75279]:   </os>
Nov 11 00:08:31 user nova-compute[75279]:   <features>
Nov 11 00:08:31 user nova-compute[75279]:     <acpi/>
Nov 11 00:08:31 user nova-compute[75279]:     <apic/>
Nov 11 00:08:31 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:08:31 user nova-compute[75279]:   </features>
Nov 11 00:08:31 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:08:31 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:08:31 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:08:31 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:08:31 user nova-compute[75279]:   </clock>
Nov 11 00:08:31 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:08:31 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:08:31 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:08:31 user nova-compute[75279]:   </cpu>
Nov 11 00:08:31 user nova-compute[75279]:   <devices>
Nov 11 00:08:31 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:08:31 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:08:31 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:08:31 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:08:31 user nova-compute[75279]:       <serial>b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e</serial>
Nov 11 00:08:31 user nova-compute[75279]:     </disk>
Nov 11 00:08:31 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:08:31 user nova-compute[75279]:       <mac address="fa:16:3e:f7:47:51"/>
Nov 11 00:08:31 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:31 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:08:31 user nova-compute[75279]:       <target dev="tapf948b442-83"/>
Nov 11 00:08:31 user nova-compute[75279]:     </interface>
Nov 11 00:08:31 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:08:31 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48/console.log" append="off"/>
Nov 11 00:08:31 user nova-compute[75279]:     </serial>
Nov 11 00:08:31 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:08:31 user nova-compute[75279]:     <video>
Nov 11 00:08:31 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:31 user nova-compute[75279]:     </video>
Nov 11 00:08:31 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:08:31 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:08:31 user nova-compute[75279]:     </rng>
Nov 11 00:08:31 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:08:31 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:08:31 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:08:31 user nova-compute[75279]:     </memballoon>
Nov 11 00:08:31 user nova-compute[75279]:   </devices>
Nov 11 00:08:31 user nova-compute[75279]: </domain>
Nov 11 00:08:31 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1721693801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG os_vif [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15ba18c5-e75b-57a4-94cd-138c9781491a', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf948b442-83, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf948b442-83, col_values=(('qos', UUID('36708d8b-678f-4329-afa2-c03acece1c47')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf948b442-83, col_values=(('external_ids', {'iface-id': 'f948b442-834c-45b5-a217-e97f753b968d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:47:51', 'vm-uuid': '508cd740-432b-433c-803f-da3892a04d48'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 08466565-73c2-45cb-abe4-c358c1cc8d36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 508cd740-432b-433c-803f-da3892a04d48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:31 user nova-compute[75279]: INFO os_vif [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83')
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] No VIF found with MAC fa:16:3e:f7:47:51, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:08:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:32 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:08:32 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:08:32 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:08:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:32 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:32 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Took 4.42 seconds to deallocate network for instance.
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-38ce1036-b8ea-47e8-b1f8-049069b7bae4 req-76541004-926a-44e8-a478-0946dae1dc94 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-deleted-3db542a4-ed25-415a-bf6d-5ca28f13d650 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-38ce1036-b8ea-47e8-b1f8-049069b7bae4 req-76541004-926a-44e8-a478-0946dae1dc94 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-deleted-75defb01-843d-43f7-b141-fa19ff74f1d0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-38ce1036-b8ea-47e8-b1f8-049069b7bae4 req-76541004-926a-44e8-a478-0946dae1dc94 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-deleted-7795e6b9-e3ef-452b-820b-0490c433e372 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-38ce1036-b8ea-47e8-b1f8-049069b7bae4 req-76541004-926a-44e8-a478-0946dae1dc94 service nova] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Received event network-vif-deleted-d9f7afa7-60a2-448b-933b-c5596ebcf9b5 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:33 user nova-compute[75279]: WARNING nova.compute.manager [req-e72802db-d552-435a-9707-b0784cb7a8f8 req-6254dbdc-6ef7-4805-851e-5463be30b43e service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state building and task_state spawning.
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYkIyFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:08:34 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:34 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:08:34 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229a56d-4f32-48a4-83f6-c548a96dd284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:08:34 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d69e8f-f395-4366-b5fb-2a6b615487f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd] added
Nov 11 00:08:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d08ee-4aff-4ef5-aac8-3a919d546fc3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.118s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b7f41-e89e-432d-8646-8af33f8b8e8c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANYkIyFW {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANYkIyFW" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[522d5fcc-2806-4281-8f55-209cee23a998]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANYkIyFW'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c583f6-18d5-43c9-9c9e-2dc80ae561b2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd393c4b-daf3-449e-9b24-2da535e7e7ff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3aa4c1-ba9a-448d-9d86-41133eb199d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260]
Nov 11 00:08:35 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260] successful.
Nov 11 00:08:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d57f17-ab64-442f-be40-42b9f64718dd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdd651-034b-4ec0-90dd-64f5b8119101]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:08:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:08:35 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:08:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3eae1f-5d0b-43c0-9b8a-c561c509e2a0]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYkIyFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:08:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance spawned successfully.
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:35 user nova-compute[75279]: INFO nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:35 user nova-compute[75279]: WARNING nova.compute.manager [req-2001a9f6-a465-4b04-912d-f3b5f7ec9407 req-34d343e5-bb42-4375-a668-a33e77474fe3 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state building and task_state spawning.
Nov 11 00:08:35 user nova-compute[75279]: INFO nova.compute.manager [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Took 52.80 seconds to build instance.
Nov 11 00:08:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d750e4b8-86d2-4ab8-b9e6-926f4df34e4e tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.926s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26235653436343861', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653436343861', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:08:36 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:08:36 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:08:36 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:08:36 user nova-compute[75279]:   <serial>e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd</serial>
Nov 11 00:08:36 user nova-compute[75279]: </disk>
Nov 11 00:08:36 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:dd:86:c2, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:08:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d7f99edf-0279-4f82-ae52-64c7cff4bd6e tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.096s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:08:41 user nova-compute[75279]: INFO nova.compute.claims [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Claim successful on node user
Nov 11 00:08:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:08:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.policy [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1203d275ebd34ce1a5840ca4b34f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683d6ebfe4794b67b6ec49ce83a46745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:08:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Creating image(s)
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "/opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.237s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk 1073741824" returned: 0 in 0.058s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:08:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Cannot resize image /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Ensure instance console log exists: /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Successfully created port: 2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Successfully updated port: 2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquired lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-changed-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Refreshing instance network info cache due to event network-changed-2d7cbc46-e03f-45bc-81df-a8a850b168b9. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] Acquiring lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updating instance_info_cache with network_info: [{"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Releasing lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Instance network_info: |[{"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] Acquired lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.neutron [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Refreshing network info cache for port 2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Start _get_guest_xml network_info=[{"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:08:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718785824',display_name='tempest-AttachVolumeNegativeTest-server-1718785824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718785824',id=18,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErl4hZ1pMxvhGkASx5OwuqHFwwbrYYA0EsYqr2AYoESQguuX6+3Hqf5naw53bpD4Hu1dFy8dSvkX1VIlopGIDVXaC11ybALipFCqDHuNGE9AhAKnzOkxflCz9zttSYnPA==',key_name='tempest-keypair-548531387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-eqcxcjok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=5326f704-1730-453a-b3c4-b8488527688d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.objects.instance [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'pci_devices' on Instance uuid 5326f704-1730-453a-b3c4-b8488527688d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:08:44 user nova-compute[75279]:   <uuid>5326f704-1730-453a-b3c4-b8488527688d</uuid>
Nov 11 00:08:44 user nova-compute[75279]:   <name>instance-00000012</name>
Nov 11 00:08:44 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:08:44 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:08:44 user nova-compute[75279]:   <metadata>
Nov 11 00:08:44 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:08:44 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1718785824</nova:name>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:08:44</nova:creationTime>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:08:44 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:08:44 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:owner>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:user uuid="1203d275ebd34ce1a5840ca4b34f2754">tempest-AttachVolumeNegativeTest-1189596006-project-member</nova:user>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:project uuid="683d6ebfe4794b67b6ec49ce83a46745">tempest-AttachVolumeNegativeTest-1189596006</nova:project>
Nov 11 00:08:44 user nova-compute[75279]:       </nova:owner>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:08:44 user nova-compute[75279]:       <nova:ports>
Nov 11 00:08:44 user nova-compute[75279]:         <nova:port uuid="2d7cbc46-e03f-45bc-81df-a8a850b168b9">
Nov 11 00:08:44 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 00:08:44 user nova-compute[75279]:         </nova:port>
Nov 11 00:08:44 user nova-compute[75279]:       </nova:ports>
Nov 11 00:08:44 user nova-compute[75279]:     </nova:instance>
Nov 11 00:08:44 user nova-compute[75279]:   </metadata>
Nov 11 00:08:44 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:08:44 user nova-compute[75279]:     <system>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="serial">5326f704-1730-453a-b3c4-b8488527688d</entry>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="uuid">5326f704-1730-453a-b3c4-b8488527688d</entry>
Nov 11 00:08:44 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:08:44 user nova-compute[75279]:     </system>
Nov 11 00:08:44 user nova-compute[75279]:   </sysinfo>
Nov 11 00:08:44 user nova-compute[75279]:   <os>
Nov 11 00:08:44 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:08:44 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:08:44 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:08:44 user nova-compute[75279]:   </os>
Nov 11 00:08:44 user nova-compute[75279]:   <features>
Nov 11 00:08:44 user nova-compute[75279]:     <acpi/>
Nov 11 00:08:44 user nova-compute[75279]:     <apic/>
Nov 11 00:08:44 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:08:44 user nova-compute[75279]:   </features>
Nov 11 00:08:44 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:08:44 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:08:44 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:08:44 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:08:44 user nova-compute[75279]:   </clock>
Nov 11 00:08:44 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:08:44 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:08:44 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:08:44 user nova-compute[75279]:   </cpu>
Nov 11 00:08:44 user nova-compute[75279]:   <devices>
Nov 11 00:08:44 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:08:44 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:08:44 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk"/>
Nov 11 00:08:44 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:08:44 user nova-compute[75279]:     </disk>
Nov 11 00:08:44 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:08:44 user nova-compute[75279]:       <mac address="fa:16:3e:e2:01:db"/>
Nov 11 00:08:44 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:44 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:08:44 user nova-compute[75279]:       <target dev="tap2d7cbc46-e0"/>
Nov 11 00:08:44 user nova-compute[75279]:     </interface>
Nov 11 00:08:44 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:08:44 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/console.log" append="off"/>
Nov 11 00:08:44 user nova-compute[75279]:     </serial>
Nov 11 00:08:44 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:08:44 user nova-compute[75279]:     <video>
Nov 11 00:08:44 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:44 user nova-compute[75279]:     </video>
Nov 11 00:08:44 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:08:44 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:08:44 user nova-compute[75279]:     </rng>
Nov 11 00:08:44 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:08:44 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:08:44 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:08:44 user nova-compute[75279]:     </memballoon>
Nov 11 00:08:44 user nova-compute[75279]:   </devices>
Nov 11 00:08:44 user nova-compute[75279]: </domain>
Nov 11 00:08:44 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718785824',display_name='tempest-AttachVolumeNegativeTest-server-1718785824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718785824',id=18,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErl4hZ1pMxvhGkASx5OwuqHFwwbrYYA0EsYqr2AYoESQguuX6+3Hqf5naw53bpD4Hu1dFy8dSvkX1VIlopGIDVXaC11ybALipFCqDHuNGE9AhAKnzOkxflCz9zttSYnPA==',key_name='tempest-keypair-548531387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-eqcxcjok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=5326f704-1730-453a-b3c4-b8488527688d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG os_vif [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af288d68-07b7-5c23-ac13-5144765e79b0', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d7cbc46-e0, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d7cbc46-e0, col_values=(('qos', UUID('0e1eaba4-86eb-4e1d-9f8e-1ff7c73e350a')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d7cbc46-e0, col_values=(('external_ids', {'iface-id': '2d7cbc46-e03f-45bc-81df-a8a850b168b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:01:db', 'vm-uuid': '5326f704-1730-453a-b3c4-b8488527688d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:44 user nova-compute[75279]: INFO os_vif [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0')
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:08:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:e2:01:db, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:08:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updated VIF entry in instance network info cache for port 2d7cbc46-e03f-45bc-81df-a8a850b168b9. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:08:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updating instance_info_cache with network_info: [{"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2586e72b-7124-408b-813f-54acfc52a741 req-72de0f74-b509-4470-9646-aa3f835afb98 service nova] Releasing lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] No waiting events found dispatching network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:46 user nova-compute[75279]: WARNING nova.compute.manager [req-cfae58f9-ce98-4eaf-8879-695b9d81c2b7 req-32c8c447-9629-4a9f-ba6e-f426d15fcecc service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received unexpected event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 for instance with vm_state building and task_state spawning.
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:08:46 user nova-compute[75279]: INFO nova.compute.claims [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Claim successful on node user
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:08:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.policy [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '818b35f397a6467f8dec8eb37cef2ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2918206b132a4855a996eac99bbf5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:08:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Creating image(s)
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk 1073741824" returned: 0 in 0.057s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Successfully created port: d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Cannot resize image /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Ensure instance console log exists: /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] No waiting events found dispatching network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:48 user nova-compute[75279]: WARNING nova.compute.manager [req-d3e58780-b64b-46a7-9ab3-fe9597abfe37 req-30f348c9-2c08-4d1d-a581-81358e24295c service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received unexpected event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 for instance with vm_state building and task_state spawning.
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:08:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Instance spawned successfully.
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:48 user nova-compute[75279]: INFO nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 11 00:08:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:08:48 user nova-compute[75279]: INFO nova.compute.manager [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Took 7.35 seconds to build instance.
Nov 11 00:08:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-088e851f-4779-4d1d-8c15-73918875da66 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.532s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Successfully updated port: d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance network_info: |[{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start _get_guest_xml network_info=[{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:08:49 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:49 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1121013036',display_name='tempest-ServerRescueNegativeTestJSON-server-1121013036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1121013036',id=19,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtSClAvXtKr6JVW5NihJfFVYFdhstg4smHU7qUBqjmt2NH5LJuvPb2M70olryln7+NEi/su0iyugOlAg03uS7EgMms9+UuREHZ4+KEqGcR0pFYtRctX9lbsVyzFeM74HA==',key_name='tempest-keypair-1990191476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-703kr6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=e3ca7730-9c3a-430e-83bd-500aac5a7d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.objects.instance [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:08:49 user nova-compute[75279]:   <uuid>e3ca7730-9c3a-430e-83bd-500aac5a7d7b</uuid>
Nov 11 00:08:49 user nova-compute[75279]:   <name>instance-00000013</name>
Nov 11 00:08:49 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:08:49 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:08:49 user nova-compute[75279]:   <metadata>
Nov 11 00:08:49 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:08:49 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1121013036</nova:name>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:08:49</nova:creationTime>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:08:49 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:08:49 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:owner>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 11 00:08:49 user nova-compute[75279]:       </nova:owner>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:08:49 user nova-compute[75279]:       <nova:ports>
Nov 11 00:08:49 user nova-compute[75279]:         <nova:port uuid="d2b67918-8939-4890-ba8f-0001db5ba09b">
Nov 11 00:08:49 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:08:49 user nova-compute[75279]:         </nova:port>
Nov 11 00:08:49 user nova-compute[75279]:       </nova:ports>
Nov 11 00:08:49 user nova-compute[75279]:     </nova:instance>
Nov 11 00:08:49 user nova-compute[75279]:   </metadata>
Nov 11 00:08:49 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:08:49 user nova-compute[75279]:     <system>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="serial">e3ca7730-9c3a-430e-83bd-500aac5a7d7b</entry>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="uuid">e3ca7730-9c3a-430e-83bd-500aac5a7d7b</entry>
Nov 11 00:08:49 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:08:49 user nova-compute[75279]:     </system>
Nov 11 00:08:49 user nova-compute[75279]:   </sysinfo>
Nov 11 00:08:49 user nova-compute[75279]:   <os>
Nov 11 00:08:49 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:08:49 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:08:49 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:08:49 user nova-compute[75279]:   </os>
Nov 11 00:08:49 user nova-compute[75279]:   <features>
Nov 11 00:08:49 user nova-compute[75279]:     <acpi/>
Nov 11 00:08:49 user nova-compute[75279]:     <apic/>
Nov 11 00:08:49 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:08:49 user nova-compute[75279]:   </features>
Nov 11 00:08:49 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:08:49 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:08:49 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:08:49 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:08:49 user nova-compute[75279]:   </clock>
Nov 11 00:08:49 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:08:49 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:08:49 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:08:49 user nova-compute[75279]:   </cpu>
Nov 11 00:08:49 user nova-compute[75279]:   <devices>
Nov 11 00:08:49 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:08:49 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:08:49 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk"/>
Nov 11 00:08:49 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:08:49 user nova-compute[75279]:     </disk>
Nov 11 00:08:49 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:08:49 user nova-compute[75279]:       <mac address="fa:16:3e:c6:03:ab"/>
Nov 11 00:08:49 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:49 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:08:49 user nova-compute[75279]:       <target dev="tapd2b67918-89"/>
Nov 11 00:08:49 user nova-compute[75279]:     </interface>
Nov 11 00:08:49 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:08:49 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/console.log" append="off"/>
Nov 11 00:08:49 user nova-compute[75279]:     </serial>
Nov 11 00:08:49 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:08:49 user nova-compute[75279]:     <video>
Nov 11 00:08:49 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:08:49 user nova-compute[75279]:     </video>
Nov 11 00:08:49 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:08:49 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:08:49 user nova-compute[75279]:     </rng>
Nov 11 00:08:49 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:08:49 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:08:49 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:08:49 user nova-compute[75279]:     </memballoon>
Nov 11 00:08:49 user nova-compute[75279]:   </devices>
Nov 11 00:08:49 user nova-compute[75279]: </domain>
Nov 11 00:08:49 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1121013036',display_name='tempest-ServerRescueNegativeTestJSON-server-1121013036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1121013036',id=19,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtSClAvXtKr6JVW5NihJfFVYFdhstg4smHU7qUBqjmt2NH5LJuvPb2M70olryln7+NEi/su0iyugOlAg03uS7EgMms9+UuREHZ4+KEqGcR0pFYtRctX9lbsVyzFeM74HA==',key_name='tempest-keypair-1990191476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-703kr6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=e3ca7730-9c3a-430e-83bd-500aac5a7d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG os_vif [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cb972a8-6d72-591a-b352-be7fd246f739', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2b67918-89, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2b67918-89, col_values=(('qos', UUID('fc0280e1-95ef-4dc5-9403-9cd3f60534b6')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2b67918-89, col_values=(('external_ids', {'iface-id': 'd2b67918-8939-4890-ba8f-0001db5ba09b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:03:ab', 'vm-uuid': 'e3ca7730-9c3a-430e-83bd-500aac5a7d7b'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:49 user nova-compute[75279]: INFO os_vif [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89')
Nov 11 00:08:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:c6:03:ab, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing instance network info cache due to event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:08:50 user nova-compute[75279]: DEBUG nova.network.neutron [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updated VIF entry in instance network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21579c1a-a583-41bd-ba2f-bd650a9f3163 req-45efb076-05bb-4c58-b2d0-8ec254c0f2a9 service nova] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:52 user nova-compute[75279]: WARNING nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state building and task_state spawning.
Nov 11 00:08:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:52 user nova-compute[75279]: WARNING nova.compute.manager [req-e7aadf4c-c184-4416-86ee-3bb08c6d0fc6 req-7826f428-738e-40b1-a410-5789a99326e9 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state building and task_state spawning.
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:08:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance spawned successfully.
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:08:54 user nova-compute[75279]: INFO nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 11 00:08:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:08:54 user nova-compute[75279]: INFO nova.compute.manager [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Took 8.07 seconds to build instance.
Nov 11 00:08:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-061e4543-79e4-438e-abc5-5baa9d239c68 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.210s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:56 user nova-compute[75279]: INFO nova.compute.manager [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Terminating instance
Nov 11 00:08:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-unplugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] No waiting events found dispatching network-vif-unplugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff495b0a-51d1-436a-9b3a-98ac5e214e83 req-9a2a11b1-3812-403e-9c08-3173c916bf32 service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-unplugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:08:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Instance destroyed successfully.
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lazy-loading 'resources' on Instance uuid 853efb46-0620-4ed9-8c5e-f3afd8ec9db7 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-553116128',display_name='tempest-VolumesAdminNegativeTest-server-553116128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-553116128',id=7,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC2GQKy2hfd476KX4pLncknJnBj6rZJhg/MvMZdhtU4OXwZXdgxikePRARNwyqOwaBDmNjPOT+0/n0F/rm1pq3c7W8nWCeqxUAugUeoqhoLVGgRO9+4Lf2ki0JX/GiPwA==',key_name='tempest-keypair-1410117559',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85b710cbbc6b4c30b39641d41de04c9b',ramdisk_id='',reservation_id='r-mgm4a005',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2020423556',owner_user_name='tempest-VolumesAdminNegativeTest-2020423556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b84093a1d3747dab7267e4dd4a2d637',uuid=853efb46-0620-4ed9-8c5e-f3afd8ec9db7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converting VIF {"id": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "address": "fa:16:3e:8f:15:c7", "network": {"id": "00d3deaf-dfa9-456c-b598-6fc9df67cb76", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-102797904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85b710cbbc6b4c30b39641d41de04c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37aa5ad9-06", "ovs_interfaceid": "37aa5ad9-060d-488b-9142-2e87dd6f6451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG os_vif [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37aa5ad9-06, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1964dabc-5bdc-4438-a97a-90a51b097c7b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:08:57 user nova-compute[75279]: INFO os_vif [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:15:c7,bridge_name='br-int',has_traffic_filtering=True,id=37aa5ad9-060d-488b-9142-2e87dd6f6451,network=Network(00d3deaf-dfa9-456c-b598-6fc9df67cb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37aa5ad9-06')
Nov 11 00:08:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Deleting instance files /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7_del
Nov 11 00:08:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Deletion of /opt/stack/data/nova/instances/853efb46-0620-4ed9-8c5e-f3afd8ec9db7_del complete
Nov 11 00:08:57 user nova-compute[75279]: INFO nova.compute.manager [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 11 00:08:57 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:08:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:08:58 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Took 1.12 seconds to deallocate network for instance.
Nov 11 00:08:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] Acquiring lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] No waiting events found dispatching network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:08:58 user nova-compute[75279]: WARNING nova.compute.manager [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received unexpected event network-vif-plugged-37aa5ad9-060d-488b-9142-2e87dd6f6451 for instance with vm_state deleted and task_state None.
Nov 11 00:08:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-eadc6a07-fabb-4324-bcf6-57bca6aaf1f5 req-77800f83-afb5-4ae1-99af-63be3238f3db service nova] [instance: 853efb46-0620-4ed9-8c5e-f3afd8ec9db7] Received event network-vif-deleted-37aa5ad9-060d-488b-9142-2e87dd6f6451 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:08:59 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:08:59 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:08:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:59 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Deleted allocations for instance 853efb46-0620-4ed9-8c5e-f3afd8ec9db7
Nov 11 00:08:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-17f737e6-dbf0-49cd-87d4-efd574af99f4 tempest-VolumesAdminNegativeTest-2020423556 tempest-VolumesAdminNegativeTest-2020423556-project-member] Lock "853efb46-0620-4ed9-8c5e-f3afd8ec9db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:08:59 user nova-compute[75279]: INFO nova.compute.manager [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] [instance: 1a4b49b1-6c6d-45fa-b071-fd762d25576d] Took 27.12 seconds to detach 3 volumes for instance.
Nov 11 00:09:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:00 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:09:00 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:09:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:00 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Deleted allocations for instance 1a4b49b1-6c6d-45fa-b071-fd762d25576d
Nov 11 00:09:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e16c31f-be81-4dd0-8118-77f49ac719e1 tempest-TaggedBootDevicesTest-1521019086 tempest-TaggedBootDevicesTest-1521019086-project-member] Lock "1a4b49b1-6c6d-45fa-b071-fd762d25576d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 36.777s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:15 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:09:15 user nova-compute[75279]: INFO nova.compute.claims [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Claim successful on node user
Nov 11 00:09:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:09:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:09:16 user nova-compute[75279]: DEBUG nova.policy [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223cf2dd1ecd4a12a5db181391692422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5707b16ebb6042e08f11590de3c92bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:09:16 user nova-compute[75279]: INFO nova.virt.block_device [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Booting with blank volume at /dev/vda
Nov 11 00:09:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Successfully created port: 4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Successfully updated port: 4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-changed-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Refreshing instance network info cache due to event network-changed-4439a833-cca8-4f9b-ad1f-f6684b2af4b9. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:09:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance network_info: |[{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Refreshing network info cache for port 4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updated VIF entry in instance network info cache for port 4439a833-cca8-4f9b-ad1f-f6684b2af4b9. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b191e77-dde8-4699-8e2d-a8e0c123a121 req-e2146c43-8da0-4fc8-b8cd-094428ea08df service nova] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:21 user nova-compute[75279]: INFO nova.compute.manager [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Detaching volume 7ecd0446-258d-4b65-a0bc-86e6cedf75e0
Nov 11 00:09:21 user nova-compute[75279]: INFO nova.virt.block_device [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Attempting to driver detach volume 7ecd0446-258d-4b65-a0bc-86e6cedf75e0 from mountpoint /dev/vdb
Nov 11 00:09:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Attempting to detach device vdb from instance 08466565-73c2-45cb-abe4-c358c1cc8d36 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:09:21 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:09:21 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:09:21 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:09:21 user nova-compute[75279]:   <serial>7ecd0446-258d-4b65-a0bc-86e6cedf75e0</serial>
Nov 11 00:09:21 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:09:21 user nova-compute[75279]: </disk>
Nov 11 00:09:21 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:09:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully detached device vdb from instance 08466565-73c2-45cb-abe4-c358c1cc8d36 from the persistent domain config.
Nov 11 00:09:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08466565-73c2-45cb-abe4-c358c1cc8d36 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:09:21 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:09:21 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:09:21 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:09:21 user nova-compute[75279]:   <serial>7ecd0446-258d-4b65-a0bc-86e6cedf75e0</serial>
Nov 11 00:09:21 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:09:21 user nova-compute[75279]: </disk>
Nov 11 00:09:21 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:09:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.utils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e086a62-91be-4c66-a1f5-9e0ae877047d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b05733c-78d8-47e4-84fe-4eb420195949]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2ddc7-7821-4603-be21-9d43247effae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9afa68-e89b-43fa-824d-73f7911b1b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:09:27 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:09:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1906ab-2a9a-4f38-aa49-bec87f47d41c]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG os_brick.utils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:09:27 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating existing volume attachment record: 71550093-3fa6-4885-bda9-4b74d7ce3128 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:09:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:33 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:33 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=25.35305404663086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 08466565-73c2-45cb-abe4-c358c1cc8d36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 508cd740-432b-433c-803f-da3892a04d48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 5326f704-1730-453a-b3c4-b8488527688d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:09:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:34 user nova-compute[75279]: INFO nova.compute.manager [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Detaching volume acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:09:34 user nova-compute[75279]: INFO nova.virt.block_device [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Attempting to driver detach volume acc6c741-d906-4ead-898d-550c4bb5770c from mountpoint /dev/vdb
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Attempting to detach device vdb from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:09:34 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:09:34 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:09:34 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:09:34 user nova-compute[75279]:   <serial>acc6c741-d906-4ead-898d-550c4bb5770c</serial>
Nov 11 00:09:34 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:09:34 user nova-compute[75279]: </disk>
Nov 11 00:09:34 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:09:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully detached device vdb from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the persistent domain config.
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:09:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:09:34 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:09:34 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:09:34 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:09:34 user nova-compute[75279]:   <serial>acc6c741-d906-4ead-898d-550c4bb5770c</serial>
Nov 11 00:09:34 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:09:34 user nova-compute[75279]: </disk>
Nov 11 00:09:34 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquired lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'info_cache' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Releasing lock "refresh_cache-83af4515-8148-461e-9682-9c5917ad61ea" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance destroyed successfully.
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'resources' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG os_vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:09:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2af150b-68, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d42576a3-6dd9-4ae5-890b-e1e6e443d849) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:36 user nova-compute[75279]: INFO os_vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start _get_guest_xml network_info=[{"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'numa_topology' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'pci_devices' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:09:36 user nova-compute[75279]:   <uuid>83af4515-8148-461e-9682-9c5917ad61ea</uuid>
Nov 11 00:09:36 user nova-compute[75279]:   <name>instance-00000002</name>
Nov 11 00:09:36 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:09:36 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:09:36 user nova-compute[75279]:   <metadata>
Nov 11 00:09:36 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:09:36 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeTestJSON-server-530644997</nova:name>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:09:36</nova:creationTime>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:09:36 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:09:36 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:owner>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:user uuid="4d3793bc64e645f3b220d49f6c409904">tempest-AttachVolumeTestJSON-896218417-project-member</nova:user>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:project uuid="1be6b384229b48c4b9cf6c8f134967d1">tempest-AttachVolumeTestJSON-896218417</nova:project>
Nov 11 00:09:36 user nova-compute[75279]:       </nova:owner>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:09:36 user nova-compute[75279]:       <nova:ports>
Nov 11 00:09:36 user nova-compute[75279]:         <nova:port uuid="c2af150b-6845-4dba-95c9-897b82ee2715">
Nov 11 00:09:36 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:09:36 user nova-compute[75279]:         </nova:port>
Nov 11 00:09:36 user nova-compute[75279]:       </nova:ports>
Nov 11 00:09:36 user nova-compute[75279]:     </nova:instance>
Nov 11 00:09:36 user nova-compute[75279]:   </metadata>
Nov 11 00:09:36 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:09:36 user nova-compute[75279]:     <system>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="serial">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="uuid">83af4515-8148-461e-9682-9c5917ad61ea</entry>
Nov 11 00:09:36 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:09:36 user nova-compute[75279]:     </system>
Nov 11 00:09:36 user nova-compute[75279]:   </sysinfo>
Nov 11 00:09:36 user nova-compute[75279]:   <os>
Nov 11 00:09:36 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:09:36 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:09:36 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:09:36 user nova-compute[75279]:   </os>
Nov 11 00:09:36 user nova-compute[75279]:   <features>
Nov 11 00:09:36 user nova-compute[75279]:     <acpi/>
Nov 11 00:09:36 user nova-compute[75279]:     <apic/>
Nov 11 00:09:36 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:09:36 user nova-compute[75279]:   </features>
Nov 11 00:09:36 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:09:36 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:09:36 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:09:36 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:09:36 user nova-compute[75279]:   </clock>
Nov 11 00:09:36 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:09:36 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:09:36 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:09:36 user nova-compute[75279]:   </cpu>
Nov 11 00:09:36 user nova-compute[75279]:   <devices>
Nov 11 00:09:36 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:09:36 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:09:36 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk"/>
Nov 11 00:09:36 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:09:36 user nova-compute[75279]:     </disk>
Nov 11 00:09:36 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:09:36 user nova-compute[75279]:       <mac address="fa:16:3e:9d:b7:6d"/>
Nov 11 00:09:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:09:36 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:09:36 user nova-compute[75279]:       <target dev="tapc2af150b-68"/>
Nov 11 00:09:36 user nova-compute[75279]:     </interface>
Nov 11 00:09:36 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:09:36 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/console.log" append="off"/>
Nov 11 00:09:36 user nova-compute[75279]:     </serial>
Nov 11 00:09:36 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:09:36 user nova-compute[75279]:     <video>
Nov 11 00:09:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:09:36 user nova-compute[75279]:     </video>
Nov 11 00:09:36 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:09:36 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:09:36 user nova-compute[75279]:     </rng>
Nov 11 00:09:36 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:09:36 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:09:36 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:09:36 user nova-compute[75279]:     </memballoon>
Nov 11 00:09:36 user nova-compute[75279]:   </devices>
Nov 11 00:09:36 user nova-compute[75279]: </domain>
Nov 11 00:09:36 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:09:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Cannot resize image /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'migration_context' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.objects.base [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Object Instance<83af4515-8148-461e-9682-9c5917ad61ea> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG os_vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73f7cab1-cf74-59f0-bd96-3d4316552ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2af150b-68, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2af150b-68, col_values=(('qos', UUID('92f31478-f7de-477e-a1d4-e141a2876fde')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2af150b-68, col_values=(('external_ids', {'iface-id': 'c2af150b-6845-4dba-95c9-897b82ee2715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b7:6d', 'vm-uuid': '83af4515-8148-461e-9682-9c5917ad61ea'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:37 user nova-compute[75279]: INFO os_vif [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 11 00:09:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:09:38 user nova-compute[75279]: WARNING nova.compute.manager [req-a5cb83ac-da9e-4598-a6ac-dc2072b1848f req-d682ec96-925e-4d76-b787-d248dc896c33 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state powering-on.
Nov 11 00:09:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:09:40 user nova-compute[75279]: WARNING nova.compute.manager [req-33155286-c326-4218-81b1-683fd16ad517 req-233c9849-5062-4b32-9167-585d85c75093 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state stopped and task_state powering-on.
Nov 11 00:09:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:09:41 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance rebooted successfully.
Nov 11 00:09:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d95c0f3d-0e24-4b2d-9ac4-649552ae6374 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:09:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:42 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08466565-73c2-45cb-abe4-c358c1cc8d36 is timed out.
Nov 11 00:09:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully detached device vdb from instance 08466565-73c2-45cb-abe4-c358c1cc8d36 from the live domain config.
Nov 11 00:09:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnimBcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:09:42 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d2b67a-0eb6-4531-af4f-fc49da54c1fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:09:42 user nova-compute[75279]: No targets found.
Nov 11 00:09:42 user nova-compute[75279]: iSNS:
Nov 11 00:09:42 user nova-compute[75279]: No targets found.
Nov 11 00:09:42 user nova-compute[75279]: STATIC:
Nov 11 00:09:42 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:09:42 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:42 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:42 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0
Nov 11 00:09:42 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:42 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:42 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:09:42 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:42 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:42 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:09:42 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:42 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:42 user nova-compute[75279]: FIRMWARE:
Nov 11 00:09:42 user nova-compute[75279]: No targets found.
Nov 11 00:09:42 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:09:42 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:09:42 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a563d96-798f-4cf0-8e77-475742e3a501]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b1a95-1340-4525-802e-21a173ee721b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:42 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:42 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:42 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0449120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f255a6a-608f-47b9-962a-8763f802ba2e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55663faf-1e28-4665-992c-ae4efba88210]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e2eb1-835d-446b-a9e3-b151ffcc55ae]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4308b-fab8-4f3d-b818-6af490864c19]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a2d6f-0fc2-462d-85f0-37c2596edc53]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9d1914-bad7-41c8-be07-547b19a18210]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260]
Nov 11 00:09:42 user nova-compute[75279]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0, portal: 172.16.0.220,3260] successful.
Nov 11 00:09:42 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b602c34-092b-4e51-99c3-6784676f94c2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== disconnect_volume: return (383ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:09:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG nova.objects.instance [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-960b8743-aec9-46ec-8ed7-87df539c9fd1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.340s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.185s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:43 user nova-compute[75279]: INFO nova.compute.manager [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Terminating instance
Nov 11 00:09:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:09:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-unplugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] No waiting events found dispatching network-vif-unplugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-4a601e61-6b82-4ef5-8626-890ea4dea9e0 req-64d156f0-3ec7-4693-a070-342c623708d6 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-unplugged-a747ac01-9d33-4fe7-8189-d8f61b429423 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:09:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Instance destroyed successfully.
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'resources' on Instance uuid 08466565-73c2-45cb-abe4-c358c1cc8d36 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1073569839',display_name='tempest-VolumesSnapshotTestJSON-instance-1073569839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1073569839',id=13,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxdQbhoVZWPr5sjUIcDybn/keoSmRvgH59M3doZHDvK5kvRAmUncXFbaxLXdW8nd/HoUyIGVTzfW3MLbOkwNtr8Uvx2akyM+gdmiNGLtW7VJI/ArPehQBwv4YxWd8cDNQ==',key_name='tempest-keypair-1655407973',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:05:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-ywl1czey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=08466565-73c2-45cb-abe4-c358c1cc8d36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "a747ac01-9d33-4fe7-8189-d8f61b429423", "address": "fa:16:3e:03:84:10", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa747ac01-9d", "ovs_interfaceid": "a747ac01-9d33-4fe7-8189-d8f61b429423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_vif [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa747ac01-9d, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acc9316f-805d-4e3c-bb5a-36f1cac7d1e1) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:44 user nova-compute[75279]: INFO os_vif [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:84:10,bridge_name='br-int',has_traffic_filtering=True,id=a747ac01-9d33-4fe7-8189-d8f61b429423,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa747ac01-9d')
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnimBcVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:09:44 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238a7ba-1301-4e06-96ec-5f05ca16db33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:09:44 user nova-compute[75279]: No targets found.
Nov 11 00:09:44 user nova-compute[75279]: iSNS:
Nov 11 00:09:44 user nova-compute[75279]: No targets found.
Nov 11 00:09:44 user nova-compute[75279]: STATIC:
Nov 11 00:09:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:09:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:09:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:09:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:44 user nova-compute[75279]: FIRMWARE:
Nov 11 00:09:44 user nova-compute[75279]: No targets found.
Nov 11 00:09:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:09:44 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:09:44 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ecd0446-258d-4b65-a0bc-86e6cedf75e0', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d1cc1-355b-4999-8c6d-34077503e070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[146cad03-35fd-4476-81b8-c3704c250bba]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:44 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:44 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:44 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:44 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f82c0040>, {}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Disconnecting from: [] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== disconnect_volume: return (86ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:09:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Deleting instance files /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36_del
Nov 11 00:09:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Deletion of /opt/stack/data/nova/instances/08466565-73c2-45cb-abe4-c358c1cc8d36_del complete
Nov 11 00:09:44 user nova-compute[75279]: INFO nova.compute.manager [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 11 00:09:44 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:09:44 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:09:45 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:45 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Took 0.92 seconds to deallocate network for instance.
Nov 11 00:09:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-ddd86d94-3f3e-42f3-a3ad-bc120e431c01 req-1e5b85ce-4c68-47c1-94e7-33e46ba2f0d0 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-deleted-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:45 user nova-compute[75279]: INFO nova.compute.manager [req-ddd86d94-3f3e-42f3-a3ad-bc120e431c01 req-1e5b85ce-4c68-47c1-94e7-33e46ba2f0d0 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Neutron deleted interface a747ac01-9d33-4fe7-8189-d8f61b429423; detaching it from the instance and deleting it from the info cache
Nov 11 00:09:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-ddd86d94-3f3e-42f3-a3ad-bc120e431c01 req-1e5b85ce-4c68-47c1-94e7-33e46ba2f0d0 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:09:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-ddd86d94-3f3e-42f3-a3ad-bc120e431c01 req-1e5b85ce-4c68-47c1-94e7-33e46ba2f0d0 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Detach interface failed, port_id=a747ac01-9d33-4fe7-8189-d8f61b429423, reason: Instance 08466565-73c2-45cb-abe4-c358c1cc8d36 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:09:45 user nova-compute[75279]: WARNING nova.volume.cinder [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Attachment 131f1bf1-d9a3-441d-bb1e-b153679a6752 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 131f1bf1-d9a3-441d-bb1e-b153679a6752. (HTTP 404) (Request-ID: req-0fa95d8c-cf1a-49ee-8490-5edaaf3014b8)
Nov 11 00:09:45 user nova-compute[75279]: INFO nova.compute.manager [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Took 0.04 seconds to detach 1 volumes for instance.
Nov 11 00:09:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] Acquiring lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] No waiting events found dispatching network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:09:46 user nova-compute[75279]: WARNING nova.compute.manager [req-6558ddc3-f41c-49f8-9e8c-fa7cf9937910 req-c2217e1b-7b9e-4bff-9f1a-55c68e69fe58 service nova] [instance: 08466565-73c2-45cb-abe4-c358c1cc8d36] Received unexpected event network-vif-plugged-a747ac01-9d33-4fe7-8189-d8f61b429423 for instance with vm_state deleted and task_state None.
Nov 11 00:09:46 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:09:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:46 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Deleted allocations for instance 08466565-73c2-45cb-abe4-c358c1cc8d36
Nov 11 00:09:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6664efbb-0890-4b89-bc2b-ec8c5e7624d2 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "08466565-73c2-45cb-abe4-c358c1cc8d36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.806s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 is timed out.
Nov 11 00:09:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully detached device vdb from instance 99c2acbf-6e9d-49ee-9a91-d505c7054141 from the live domain config.
Nov 11 00:09:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shLUpQGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:09:55 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1040de4-0f4c-446f-a95d-f0e3205d8f1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:09:55 user nova-compute[75279]: No targets found.
Nov 11 00:09:55 user nova-compute[75279]: iSNS:
Nov 11 00:09:55 user nova-compute[75279]: No targets found.
Nov 11 00:09:55 user nova-compute[75279]: STATIC:
Nov 11 00:09:55 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c
Nov 11 00:09:55 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:55 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:55 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:09:55 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:55 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:55 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:09:55 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:09:55 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:09:55 user nova-compute[75279]: FIRMWARE:
Nov 11 00:09:55 user nova-compute[75279]: No targets found.
Nov 11 00:09:55 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:09:55 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:09:55 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051f3b8-4c93-4a8d-b0c8-e4f21b24d9a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e94b18-58bc-42c0-88f3-d43c47969bc4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:55 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:55 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:55 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c (non-flash)
Nov 11 00:09:55 user nova-compute[75279]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:55 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:55 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f72002e0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e15f11c-2204-4b31-af45-9c4e3729db70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[81304da9-ce85-4f4f-96ce-b3d3468b75bb]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0591227e-4e95-4f59-b7e9-cff6f5c4ede2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68042e0b-14dd-407b-99dd-56452473a526]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d64bd1a-10b4-4b42-b0d0-2eced932265d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9a8372-1ef6-491b-ac1c-d5277e2a30d4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260]
Nov 11 00:09:55 user nova-compute[75279]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c, portal: 172.16.0.220,3260] successful.
Nov 11 00:09:55 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc6c741-d906-4ead-898d-550c4bb5770c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b4183-6f8b-401f-8743-1670d2af49cc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== disconnect_volume: return (367ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:09:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:09:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Creating image(s)
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start _get_guest_xml network_info=[{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e8d0ac5-6125-425f-808c-f540f57ebc5d', 'attached_at': '', 'detached_at': '', 'volume_id': '7e39473d-2111-4332-8489-2498186b2973', 'serial': '7e39473d-2111-4332-8489-2498186b2973'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '71550093-3fa6-4885-bda9-4b74d7ce3128', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:09:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:09:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:09:56 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:09:56 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a2ad0-aabf-4fcc-ae82-3bc206e6d0fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:09:56 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[12106216-5cc0-4fa9-9b30-6a1d161567cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973] added
Nov 11 00:09:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3733386-ebe2-4a2a-89c4-034f6a0adbdd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797cc5c-35fb-4a8c-b9bb-be668d01d55d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sERMGNZH {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sERMGNZH" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2e6f0-973f-40b9-9c69-66428bc4ea64]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sERMGNZH'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed125e9-3935-47b6-bbf5-c7ef2383cf7d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168809d-4943-465b-a593-6d5e0f5e7836]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:56 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:56 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:56 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:09:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'flavor' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c5070b-545f-4896-b48c-841f2ffe88bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260]
Nov 11 00:09:57 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260] successful.
Nov 11 00:09:57 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef773084-0256-4f2e-afaf-bba673a9ccf7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-459d2677-6781-4a86-bb89-7cc2e0b7b21a tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.352s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3198e175-bda2-43f8-bf7c-210c8f21ea73]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:57 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:57 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:09:57 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:09:57 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:09:57 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:09:57 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a3671d-a6a7-4b55-ba19-570ca8ea146b]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:09:57 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26638386266353163', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638386266353163', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-553191854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-553191854',id=20,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ggghjtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:09:16Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=1e8d0ac5-6125-425f-808c-f540f57ebc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:09:58 user nova-compute[75279]:   <uuid>1e8d0ac5-6125-425f-808c-f540f57ebc5d</uuid>
Nov 11 00:09:58 user nova-compute[75279]:   <name>instance-00000014</name>
Nov 11 00:09:58 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:09:58 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:09:58 user nova-compute[75279]:   <metadata>
Nov 11 00:09:58 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:09:58 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-553191854</nova:name>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:09:56</nova:creationTime>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:09:58 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:09:58 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:owner>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:09:58 user nova-compute[75279]:       </nova:owner>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:09:58 user nova-compute[75279]:       <nova:ports>
Nov 11 00:09:58 user nova-compute[75279]:         <nova:port uuid="4439a833-cca8-4f9b-ad1f-f6684b2af4b9">
Nov 11 00:09:58 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:09:58 user nova-compute[75279]:         </nova:port>
Nov 11 00:09:58 user nova-compute[75279]:       </nova:ports>
Nov 11 00:09:58 user nova-compute[75279]:     </nova:instance>
Nov 11 00:09:58 user nova-compute[75279]:   </metadata>
Nov 11 00:09:58 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:09:58 user nova-compute[75279]:     <system>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="serial">1e8d0ac5-6125-425f-808c-f540f57ebc5d</entry>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="uuid">1e8d0ac5-6125-425f-808c-f540f57ebc5d</entry>
Nov 11 00:09:58 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:09:58 user nova-compute[75279]:     </system>
Nov 11 00:09:58 user nova-compute[75279]:   </sysinfo>
Nov 11 00:09:58 user nova-compute[75279]:   <os>
Nov 11 00:09:58 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:09:58 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:09:58 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:09:58 user nova-compute[75279]:   </os>
Nov 11 00:09:58 user nova-compute[75279]:   <features>
Nov 11 00:09:58 user nova-compute[75279]:     <acpi/>
Nov 11 00:09:58 user nova-compute[75279]:     <apic/>
Nov 11 00:09:58 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:09:58 user nova-compute[75279]:   </features>
Nov 11 00:09:58 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:09:58 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:09:58 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:09:58 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:09:58 user nova-compute[75279]:   </clock>
Nov 11 00:09:58 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:09:58 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:09:58 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:09:58 user nova-compute[75279]:   </cpu>
Nov 11 00:09:58 user nova-compute[75279]:   <devices>
Nov 11 00:09:58 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:09:58 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:09:58 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:09:58 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:09:58 user nova-compute[75279]:       <serial>7e39473d-2111-4332-8489-2498186b2973</serial>
Nov 11 00:09:58 user nova-compute[75279]:     </disk>
Nov 11 00:09:58 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:09:58 user nova-compute[75279]:       <mac address="fa:16:3e:1c:e0:58"/>
Nov 11 00:09:58 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:09:58 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:09:58 user nova-compute[75279]:       <target dev="tap4439a833-cc"/>
Nov 11 00:09:58 user nova-compute[75279]:     </interface>
Nov 11 00:09:58 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:09:58 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/console.log" append="off"/>
Nov 11 00:09:58 user nova-compute[75279]:     </serial>
Nov 11 00:09:58 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:09:58 user nova-compute[75279]:     <video>
Nov 11 00:09:58 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:09:58 user nova-compute[75279]:     </video>
Nov 11 00:09:58 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:09:58 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:09:58 user nova-compute[75279]:     </rng>
Nov 11 00:09:58 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:09:58 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:09:58 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:09:58 user nova-compute[75279]:     </memballoon>
Nov 11 00:09:58 user nova-compute[75279]:   </devices>
Nov 11 00:09:58 user nova-compute[75279]: </domain>
Nov 11 00:09:58 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-553191854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-553191854',id=20,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ggghjtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:09:16Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=1e8d0ac5-6125-425f-808c-f540f57ebc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG os_vif [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5defea5-d5f8-5c41-8bd4-c8315b27c3c7', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4439a833-cc, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4439a833-cc, col_values=(('qos', UUID('a599df9c-c351-41ac-8a32-4d7f018678c2')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4439a833-cc, col_values=(('external_ids', {'iface-id': '4439a833-cca8-4f9b-ad1f-f6684b2af4b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:e0:58', 'vm-uuid': '1e8d0ac5-6125-425f-808c-f540f57ebc5d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:58 user nova-compute[75279]: INFO os_vif [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc')
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:09:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:1c:e0:58, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:09:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:09:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:00 user nova-compute[75279]: WARNING nova.compute.manager [req-34858a91-57cd-4620-83d5-9be23867c224 req-e31b804e-1428-45f8-af80-6c69a00b743e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state building and task_state spawning.
Nov 11 00:10:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:10:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance spawned successfully.
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:02 user nova-compute[75279]: INFO nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:10:02 user nova-compute[75279]: INFO nova.compute.manager [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Took 46.86 seconds to build instance.
Nov 11 00:10:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8ca55f26-05da-4545-92db-137f72abaf2b tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.997s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:02 user nova-compute[75279]: WARNING nova.compute.manager [req-85337600-3cf4-4ea1-a354-0ca47188c1f8 req-92266785-393b-41dd-8305-c1bd79a7f399 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state None.
Nov 11 00:10:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:20 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:10:20 user nova-compute[75279]: INFO nova.compute.claims [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Claim successful on node user
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:10:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.policy [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '555cd57cc4c44e7db8846b432dd35fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0d496f01e14cc385058072a738a75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:10:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Creating image(s)
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.244s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk 1073741824" returned: 0 in 0.052s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Successfully created port: 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Cannot resize image /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Ensure instance console log exists: /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Successfully updated port: 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing instance network info cache due to event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:10:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance network_info: |[{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start _get_guest_xml network_info=[{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:10:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1921956890',display_name='tempest-ServerStableDeviceRescueTest-server-1921956890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1921956890',id=21,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMCeSGzxyiY7bAQlNe8WIu4ZeS7J65pyMy65mRNjc0eXBNtRVvwbnuPZ46CQ4/6sh5ZZdiM+sYWv5WsTe3rDouP/EYxmRWMsad7rVl3pQH72/Pbmnu8azcy2nS2q9Dc+A==',key_name='tempest-keypair-1517673478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0d496f01e14cc385058072a738a75c',ramdisk_id='',reservation_id='r-4sliv25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-26625521',owner_user_name='tempest-ServerStableDeviceRescueTest-26625521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555cd57cc4c44e7db8846b432dd35fe3',uuid=9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converting VIF {"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'pci_devices' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:10:24 user nova-compute[75279]:   <uuid>9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</uuid>
Nov 11 00:10:24 user nova-compute[75279]:   <name>instance-00000015</name>
Nov 11 00:10:24 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:10:24 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:10:24 user nova-compute[75279]:   <metadata>
Nov 11 00:10:24 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:10:24 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1921956890</nova:name>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:10:24</nova:creationTime>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:10:24 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:10:24 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:owner>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:user uuid="555cd57cc4c44e7db8846b432dd35fe3">tempest-ServerStableDeviceRescueTest-26625521-project-member</nova:user>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:project uuid="ed0d496f01e14cc385058072a738a75c">tempest-ServerStableDeviceRescueTest-26625521</nova:project>
Nov 11 00:10:24 user nova-compute[75279]:       </nova:owner>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:10:24 user nova-compute[75279]:       <nova:ports>
Nov 11 00:10:24 user nova-compute[75279]:         <nova:port uuid="89ea421e-b556-4145-b66e-7a09854cfc60">
Nov 11 00:10:24 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:10:24 user nova-compute[75279]:         </nova:port>
Nov 11 00:10:24 user nova-compute[75279]:       </nova:ports>
Nov 11 00:10:24 user nova-compute[75279]:     </nova:instance>
Nov 11 00:10:24 user nova-compute[75279]:   </metadata>
Nov 11 00:10:24 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:10:24 user nova-compute[75279]:     <system>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="serial">9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</entry>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="uuid">9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</entry>
Nov 11 00:10:24 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:10:24 user nova-compute[75279]:     </system>
Nov 11 00:10:24 user nova-compute[75279]:   </sysinfo>
Nov 11 00:10:24 user nova-compute[75279]:   <os>
Nov 11 00:10:24 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:10:24 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:10:24 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:10:24 user nova-compute[75279]:   </os>
Nov 11 00:10:24 user nova-compute[75279]:   <features>
Nov 11 00:10:24 user nova-compute[75279]:     <acpi/>
Nov 11 00:10:24 user nova-compute[75279]:     <apic/>
Nov 11 00:10:24 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:10:24 user nova-compute[75279]:   </features>
Nov 11 00:10:24 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:10:24 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:10:24 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:10:24 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:10:24 user nova-compute[75279]:   </clock>
Nov 11 00:10:24 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:10:24 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:10:24 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:10:24 user nova-compute[75279]:   </cpu>
Nov 11 00:10:24 user nova-compute[75279]:   <devices>
Nov 11 00:10:24 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:10:24 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:10:24 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk"/>
Nov 11 00:10:24 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:10:24 user nova-compute[75279]:     </disk>
Nov 11 00:10:24 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:10:24 user nova-compute[75279]:       <mac address="fa:16:3e:77:95:e8"/>
Nov 11 00:10:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:10:24 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:10:24 user nova-compute[75279]:       <target dev="tap89ea421e-b5"/>
Nov 11 00:10:24 user nova-compute[75279]:     </interface>
Nov 11 00:10:24 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:10:24 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/console.log" append="off"/>
Nov 11 00:10:24 user nova-compute[75279]:     </serial>
Nov 11 00:10:24 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:10:24 user nova-compute[75279]:     <video>
Nov 11 00:10:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:10:24 user nova-compute[75279]:     </video>
Nov 11 00:10:24 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:10:24 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:10:24 user nova-compute[75279]:     </rng>
Nov 11 00:10:24 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:10:24 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:10:24 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:10:24 user nova-compute[75279]:     </memballoon>
Nov 11 00:10:24 user nova-compute[75279]:   </devices>
Nov 11 00:10:24 user nova-compute[75279]: </domain>
Nov 11 00:10:24 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1921956890',display_name='tempest-ServerStableDeviceRescueTest-server-1921956890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1921956890',id=21,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMCeSGzxyiY7bAQlNe8WIu4ZeS7J65pyMy65mRNjc0eXBNtRVvwbnuPZ46CQ4/6sh5ZZdiM+sYWv5WsTe3rDouP/EYxmRWMsad7rVl3pQH72/Pbmnu8azcy2nS2q9Dc+A==',key_name='tempest-keypair-1517673478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed0d496f01e14cc385058072a738a75c',ramdisk_id='',reservation_id='r-4sliv25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-26625521',owner_user_name='tempest-ServerStableDeviceRescueTest-26625521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555cd57cc4c44e7db8846b432dd35fe3',uuid=9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converting VIF {"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG os_vif [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a279f4e9-3cbd-54d4-8533-3c6eedfc653e', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89ea421e-b5, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89ea421e-b5, col_values=(('qos', UUID('b08f6c30-3c46-4ec2-b395-241d285c4e5e')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89ea421e-b5, col_values=(('external_ids', {'iface-id': '89ea421e-b556-4145-b66e-7a09854cfc60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:95:e8', 'vm-uuid': '9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:24 user nova-compute[75279]: INFO os_vif [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5')
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No VIF found with MAC fa:16:3e:77:95:e8, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-changed-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Refreshing instance network info cache due to event network-changed-f948b442-834c-45b5-a217-e97f753b968d. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] Acquiring lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] Acquired lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Refreshing network info cache for port f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updated VIF entry in instance network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:10:24 user nova-compute[75279]: INFO nova.compute.claims [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Claim successful on node user
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6d41e0df-b150-4468-8dc4-1fbf09dbd9b5 req-e24f950a-dc32-4e39-8090-edd1e8a2ab0c service nova] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updated VIF entry in instance network info cache for port f948b442-834c-45b5-a217-e97f753b968d. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating instance_info_cache with network_info: [{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-88128bb7-b59e-4eb8-b7f4-4479741a6b80 req-0358d2cd-2f11-4b62-866c-2bcc47e8c468 service nova] Releasing lock "refresh_cache-508cd740-432b-433c-803f-da3892a04d48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:25 user nova-compute[75279]: INFO nova.compute.manager [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Terminating instance
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:10:25 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.policy [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d2cf04159da4f1986f253dc994074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1b87e530aa40a2a74947ac0baccc2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:10:25 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Creating image(s)
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:25 user nova-compute[75279]: INFO nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Rebuilding instance
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-449ce086-9129-4eb3-bfb3-29757e622c2d req-7a3138ab-94f7-47c7-96f5-e32bb8d1ad16 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-unplugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.263s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.238s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk 1073741824" returned: 0 in 0.079s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Cannot resize image /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Ensure instance console log exists: /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Successfully created port: 72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:10:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Instance destroyed successfully.
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.objects.instance [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'resources' on Instance uuid 99c2acbf-6e9d-49ee-9a91-d505c7054141 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1755139986',display_name='tempest-ServerActionsTestOtherA-server-1472836083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1755139986',id=12,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiakaGphRU/9oENR7bAZ/YTrZ7ktv6Kq6aRAaHPPVBuRAtrmD01a2MAD2gGWlHOh0/IwX/86gbjl2ZhuzrNfQ10vgfSHzt6oEGmuqIpz33y89QX7Y3CRrS97rICZp42g==',key_name='tempest-keypair-158368941',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-syz1ccgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=99c2acbf-6e9d-49ee-9a91-d505c7054141,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "address": "fa:16:3e:35:4e:79", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa26cb0f9-04", "ovs_interfaceid": "a26cb0f9-0416-4130-919c-550a9fa12a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_vif [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa26cb0f9-04, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance destroyed successfully.
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=288023f5-bba6-4ab9-9657-66f6a1e4f0ce) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance destroyed successfully.
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1302584730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf948b442-83, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:26 user nova-compute[75279]: INFO os_vif [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4e:79,bridge_name='br-int',has_traffic_filtering=True,id=a26cb0f9-0416-4130-919c-550a9fa12a6e,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa26cb0f9-04')
Nov 11 00:10:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Deleting instance files /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141_del
Nov 11 00:10:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Deletion of /opt/stack/data/nova/instances/99c2acbf-6e9d-49ee-9a91-d505c7054141_del complete
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36708d8b-678f-4329-afa2-c03acece1c47) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:26 user nova-compute[75279]: INFO os_vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83')
Nov 11 00:10:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:10:26 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f849a-6315-4943-acb4-a1079f2e9c08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:10:26 user nova-compute[75279]: No targets found.
Nov 11 00:10:26 user nova-compute[75279]: iSNS:
Nov 11 00:10:26 user nova-compute[75279]: No targets found.
Nov 11 00:10:26 user nova-compute[75279]: STATIC:
Nov 11 00:10:26 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:10:26 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:10:26 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:10:26 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:10:26 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:10:26 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:10:26 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:10:26 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:10:26 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:10:26 user nova-compute[75279]: FIRMWARE:
Nov 11 00:10:26 user nova-compute[75279]: No targets found.
Nov 11 00:10:26 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:10:26 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:10:26 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:10:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[58470718-84ea-434f-a52b-e5f35766ea65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: INFO nova.compute.manager [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Took 1.83 seconds to destroy the instance on the hypervisor.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebb1be8-b07c-4dd8-bb6a-b8bfbc4f1561]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e070ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d26097-e844-4179-b1ce-13f667050646]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0411e8-62f9-49dc-9086-eae26d064af3]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58688cb-5652-4289-a071-5f035c4fee97]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fbed2a-257f-4001-8d6f-f7f9c69f79e0]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f88f8-6bde-4ca9-9dea-2cf9ef61126d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f15de8-51b3-4cae-ab38-959570b2e281]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]
Nov 11 00:10:27 user nova-compute[75279]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b71831-d79b-4aef-a041-0233143eb54d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== disconnect_volume: return (379ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:10:27 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deleting instance files /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48_del
Nov 11 00:10:27 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deletion of /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48_del complete
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 508cd740-432b-433c-803f-da3892a04d48 could not be found.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Successfully updated port: 72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c907f-cc63-435c-914c-4a3fe3ac94a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:10:27 user nova-compute[75279]: No targets found.
Nov 11 00:10:27 user nova-compute[75279]: iSNS:
Nov 11 00:10:27 user nova-compute[75279]: No targets found.
Nov 11 00:10:27 user nova-compute[75279]: STATIC:
Nov 11 00:10:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:10:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:10:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:10:27 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:10:27 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:10:27 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:10:27 user nova-compute[75279]: FIRMWARE:
Nov 11 00:10:27 user nova-compute[75279]: No targets found.
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:10:27 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:10:27 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[789d0e88-f1c2-4420-805b-583edeb9d2e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[03abe98b-a915-449a-87cc-4fd59e194534]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:10:27 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:10:27 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0449000>, {}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Disconnecting from: [] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== disconnect_volume: return (89ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Acquiring lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] No waiting events found dispatching network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received unexpected event network-vif-plugged-a26cb0f9-0416-4130-919c-550a9fa12a6e for instance with vm_state active and task_state deleting.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state building and task_state spawning.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state building and task_state spawning.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state active and task_state rebuilding.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:27 user nova-compute[75279]: WARNING nova.compute.manager [req-b66f80f0-7e28-4104-895d-7d8bf32caf91 req-4252c1ca-ae4a-49e0-8a3c-794aca8292a6 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state active and task_state rebuilding.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-changed-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing instance network info cache due to event network-changed-72682323-e45b-4a04-9e61-06dbe1924488. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:27 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Took 0.78 seconds to deallocate network for instance.
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Instance network_info: |[{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.neutron [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing network info cache for port 72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Start _get_guest_xml network_info=[{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:10:28 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:28 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:10:28 user nova-compute[75279]:   <uuid>7b70effe-d5d7-4df7-946e-4da6b7c2816e</uuid>
Nov 11 00:10:28 user nova-compute[75279]:   <name>instance-00000016</name>
Nov 11 00:10:28 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:10:28 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:10:28 user nova-compute[75279]:   <metadata>
Nov 11 00:10:28 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:10:28 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:10:28</nova:creationTime>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:10:28 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:10:28 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:owner>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:10:28 user nova-compute[75279]:       </nova:owner>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:10:28 user nova-compute[75279]:       <nova:ports>
Nov 11 00:10:28 user nova-compute[75279]:         <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:10:28 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:10:28 user nova-compute[75279]:         </nova:port>
Nov 11 00:10:28 user nova-compute[75279]:       </nova:ports>
Nov 11 00:10:28 user nova-compute[75279]:     </nova:instance>
Nov 11 00:10:28 user nova-compute[75279]:   </metadata>
Nov 11 00:10:28 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:10:28 user nova-compute[75279]:     <system>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="serial">7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="uuid">7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:10:28 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:10:28 user nova-compute[75279]:     </system>
Nov 11 00:10:28 user nova-compute[75279]:   </sysinfo>
Nov 11 00:10:28 user nova-compute[75279]:   <os>
Nov 11 00:10:28 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:10:28 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:10:28 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:10:28 user nova-compute[75279]:   </os>
Nov 11 00:10:28 user nova-compute[75279]:   <features>
Nov 11 00:10:28 user nova-compute[75279]:     <acpi/>
Nov 11 00:10:28 user nova-compute[75279]:     <apic/>
Nov 11 00:10:28 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:10:28 user nova-compute[75279]:   </features>
Nov 11 00:10:28 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:10:28 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:10:28 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:10:28 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:10:28 user nova-compute[75279]:   </clock>
Nov 11 00:10:28 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:10:28 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:10:28 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:10:28 user nova-compute[75279]:   </cpu>
Nov 11 00:10:28 user nova-compute[75279]:   <devices>
Nov 11 00:10:28 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:10:28 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:10:28 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk"/>
Nov 11 00:10:28 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:10:28 user nova-compute[75279]:     </disk>
Nov 11 00:10:28 user nova-compute[75279]:     <disk type="file" device="cdrom">
Nov 11 00:10:28 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none"/>
Nov 11 00:10:28 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config"/>
Nov 11 00:10:28 user nova-compute[75279]:       <target dev="hda" bus="ide"/>
Nov 11 00:10:28 user nova-compute[75279]:     </disk>
Nov 11 00:10:28 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:10:28 user nova-compute[75279]:       <mac address="fa:16:3e:49:67:ac"/>
Nov 11 00:10:28 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:10:28 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:10:28 user nova-compute[75279]:       <target dev="tap72682323-e4"/>
Nov 11 00:10:28 user nova-compute[75279]:     </interface>
Nov 11 00:10:28 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:10:28 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log" append="off"/>
Nov 11 00:10:28 user nova-compute[75279]:     </serial>
Nov 11 00:10:28 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:10:28 user nova-compute[75279]:     <video>
Nov 11 00:10:28 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:10:28 user nova-compute[75279]:     </video>
Nov 11 00:10:28 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:10:28 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:10:28 user nova-compute[75279]:     </rng>
Nov 11 00:10:28 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:10:28 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:10:28 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:10:28 user nova-compute[75279]:     </memballoon>
Nov 11 00:10:28 user nova-compute[75279]:   </devices>
Nov 11 00:10:28 user nova-compute[75279]: </domain>
Nov 11 00:10:28 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG os_vif [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7706f77-c22d-5e13-8358-5cb10c3f80db', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72682323-e4, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72682323-e4, col_values=(('qos', UUID('808234f8-39d3-40b0-90f0-1e41963b67b2')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72682323-e4, col_values=(('external_ids', {'iface-id': '72682323-e45b-4a04-9e61-06dbe1924488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:67:ac', 'vm-uuid': '7b70effe-d5d7-4df7-946e-4da6b7c2816e'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:28 user nova-compute[75279]: INFO os_vif [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4')
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name hda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:10:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No VIF found with MAC fa:16:3e:49:67:ac, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:10:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Using config drive
Nov 11 00:10:28 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Deleted allocations for instance 99c2acbf-6e9d-49ee-9a91-d505c7054141
Nov 11 00:10:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Creating config drive at /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config
Nov 11 00:10:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphtcccq5e {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-36df9bd8-f49c-477f-9304-cbc2a9bb1966 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "99c2acbf-6e9d-49ee-9a91-d505c7054141" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updated VIF entry in instance network info cache for port 72682323-e45b-4a04-9e61-06dbe1924488. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphtcccq5e" returned: 0 in 0.158s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e1724a8-dcfa-4f2d-a3c3-c52b43c982c5 req-82db4946-d670-41c8-88b8-61a3e44325b7 service nova] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:10:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance spawned successfully.
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Preparing to wait for external event volume-reimaged-b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e {{(pid=75279) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:29 user nova-compute[75279]: INFO nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Took 7.81 seconds to spawn the instance on the hypervisor.
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:29 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:10:29 user nova-compute[75279]: INFO nova.compute.manager [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Took 8.92 seconds to build instance.
Nov 11 00:10:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ddb8132b-725b-442d-8418-5bb206742350 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.064s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-7f7f1510-5c08-4f7b-aafb-3466639e46f6 req-261b1367-e765-4029-b1d5-283686847b3b service nova] [instance: 99c2acbf-6e9d-49ee-9a91-d505c7054141] Received event network-vif-deleted-a26cb0f9-0416-4130-919c-550a9fa12a6e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:30 user nova-compute[75279]: WARNING nova.compute.manager [req-8dce68cb-da50-4d4f-89f6-1bbde4b0c36d req-51f47824-60c1-45a5-8190-d2a94102262a service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 for instance with vm_state building and task_state spawning.
Nov 11 00:10:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-changed-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Refreshing instance network info cache due to event network-changed-2d7cbc46-e03f-45bc-81df-a8a850b168b9. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] Acquiring lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] Acquired lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Refreshing network info cache for port 2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:32 user nova-compute[75279]: WARNING nova.compute.manager [req-1285a645-d5bc-4283-a473-cb8bc36fdb82 req-40fff74c-8b16-4e72-859c-7bbf28a3fe99 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 for instance with vm_state building and task_state spawning.
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:32 user nova-compute[75279]: INFO nova.compute.manager [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Terminating instance
Nov 11 00:10:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Instance spawned successfully.
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updated VIF entry in instance network info cache for port 2d7cbc46-e03f-45bc-81df-a8a850b168b9. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updating instance_info_cache with network_info: [{"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac1030ae-17da-4c3e-a6c0-de96e1aa58a2 req-2218d5be-80b2-47f8-9f84-65aa14092d43 service nova] Releasing lock "refresh_cache-5326f704-1730-453a-b3c4-b8488527688d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.compute.manager [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Took 8.87 seconds to build instance.
Nov 11 00:10:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2b0f5fe5-4e72-437e-9d00-b0c1fb4be7df tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.982s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Instance destroyed successfully.
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'resources' on Instance uuid 5326f704-1730-453a-b3c4-b8488527688d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718785824',display_name='tempest-AttachVolumeNegativeTest-server-1718785824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718785824',id=18,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErl4hZ1pMxvhGkASx5OwuqHFwwbrYYA0EsYqr2AYoESQguuX6+3Hqf5naw53bpD4Hu1dFy8dSvkX1VIlopGIDVXaC11ybALipFCqDHuNGE9AhAKnzOkxflCz9zttSYnPA==',key_name='tempest-keypair-548531387',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:08:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-eqcxcjok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=5326f704-1730-453a-b3c4-b8488527688d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "address": "fa:16:3e:e2:01:db", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7cbc46-e0", "ovs_interfaceid": "2d7cbc46-e03f-45bc-81df-a8a850b168b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG os_vif [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d7cbc46-e0, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e1eaba4-86eb-4e1d-9f8e-1ff7c73e350a) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:10:33 user nova-compute[75279]: INFO os_vif [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:01:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7cbc46-e03f-45bc-81df-a8a850b168b9,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7cbc46-e0')
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Deleting instance files /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d_del
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Deletion of /opt/stack/data/nova/instances/5326f704-1730-453a-b3c4-b8488527688d_del complete
Nov 11 00:10:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:33 user nova-compute[75279]: INFO nova.compute.manager [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 11 00:10:33 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:10:33 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-unplugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] No waiting events found dispatching network-vif-unplugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-unplugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Acquiring lock "5326f704-1730-453a-b3c4-b8488527688d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] Lock "5326f704-1730-453a-b3c4-b8488527688d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] No waiting events found dispatching network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:10:35 user nova-compute[75279]: WARNING nova.compute.manager [req-d4970014-7f57-46fd-baa9-faa7ed8d0601 req-dc5fb3b7-6bb3-4929-80d8-214cb61cbc4a service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received unexpected event network-vif-plugged-2d7cbc46-e03f-45bc-81df-a8a850b168b9 for instance with vm_state active and task_state deleting.
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:35 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Took 1.16 seconds to deallocate network for instance.
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:10:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:35 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Deleted allocations for instance 5326f704-1730-453a-b3c4-b8488527688d
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d5924d1f-7dd3-4d97-9f66-f5e27697970f tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "5326f704-1730-453a-b3c4-b8488527688d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-d9e51260-b91e-4fe8-8370-1f7368d7883f req-505465c6-6e16-4985-90d4-e35be1266716 service nova] [instance: 5326f704-1730-453a-b3c4-b8488527688d] Received event network-vif-deleted-2d7cbc46-e03f-45bc-81df-a8a850b168b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:37 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '5326f704-1730-453a-b3c4-b8488527688d' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '5326f704-1730-453a-b3c4-b8488527688d' (instance-00000012)
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing instance network info cache due to event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'flavor' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:10:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:38 user nova-compute[75279]: INFO nova.compute.manager [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Attaching volume e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c to /dev/vdb
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.utils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d483d0-abd4-47d9-b3de-4d708ae683fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updated VIF entry in instance network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[847fdeb8-73d8-4d8c-912f-79dbfad1c23a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b4c0b821-76b6-45f5-8d51-70208fd81741 req-579b4db8-b365-4ab0-b10d-88073b6be6c2 service nova] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fab39-436f-44f0-b7b1-24cb12f8a855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8258895c-f418-41a8-9ce7-1364f177b977]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:10:38 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cb840-e0ed-4e12-89b0-e89ab115b2c8]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG os_brick.utils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] <== get_connector_properties: return (246ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating existing volume attachment record: b89a3c0a-4299-4f66-be01-27869e9cc7d1 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:10:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7765MB free_disk=25.392620086669922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 83af4515-8148-461e-9682-9c5917ad61ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 508cd740-432b-433c-803f-da3892a04d48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:10:39 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:10:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:10:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:10:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:08 user nova-compute[75279]: INFO nova.compute.manager [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Rescuing
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwKksNJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:11:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:08 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdeefa-62e1-4b74-ad9d-2209712826fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:11:08 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c9343-73a6-4636-a615-6b0ffeda7f95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c] added
Nov 11 00:11:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 6 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ec061-e4fe-48c2-a718-2c80468f651b]: (4, ('', 'iscsiadm: Could not execute operation on all records: encountered iSCSI database failure\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr=iscsiadm: Could not execute operation on all records: encountered iSCSI database failure
Nov 11 00:11:08 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1964e2a7-b01f-4047-89f7-af44fd76d0f9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwKksNJv {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwKksNJv" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac28d3d-d36a-4e98-b003-2451873fbcfa]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwKksNJv'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba07aa-bfc4-43f2-9c88-71d924a241c2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4edd71e-0c23-433d-bf73-99d757573238]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:09 user nova-compute[75279]: WARNING nova.compute.manager [req-6c1528e8-4755-4105-bfb7-4e2406c86508 req-9ba11d79-891a-43f8-a5e2-8a29779f7d31 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state rescuing.
Nov 11 00:11:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825767e-0b4e-42e9-ac8a-c2ee46ef40bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260]
Nov 11 00:11:09 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260] successful.
Nov 11 00:11:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[294eb53a-6da7-4333-8dbd-e21949819d29]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a85af2-a8a2-4896-9547-63b4c83cab89]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance destroyed successfully.
Nov 11 00:11:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Attempting a stable device rescue
Nov 11 00:11:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:11:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Creating image(s)
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG nova.virt.images [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] 103f063a-8234-41b9-8b56-dfe71520f7a5 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:11:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.part /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 req-aeb89a3d-9989-4cb1-8034-cd6926522d90 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event volume-reimaged-b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 req-aeb89a3d-9989-4cb1-8034-cd6926522d90 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 req-aeb89a3d-9989-4cb1-8034-cd6926522d90 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 req-aeb89a3d-9989-4cb1-8034-cd6926522d90 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 req-aeb89a3d-9989-4cb1-8034-cd6926522d90 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Processing event volume-reimaged-b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance event wait completed in 41 seconds for volume-reimaged {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:11 user nova-compute[75279]: WARNING nova.compute.manager [req-77320ee4-7ccc-4af5-94c5-ffb7a127b074 req-2f07124d-2594-4448-aba4-380ba0f32005 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state rescuing.
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.part /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.converted" returned: 0 in 0.301s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: INFO nova.virt.block_device [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Booting with volume b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e at /dev/vda
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "ea374667-4ec1-4242-8838-a0ab8cff08b0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquired lock "ea374667-4ec1-4242-8838-a0ab8cff08b0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquired external semaphore "ea374667-4ec1-4242-8838-a0ab8cff08b0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.utils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f79998-f8d9-400a-a740-0c19a73cff32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.823s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd43a2d-171a-44d9-9643-9854b23ab915]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3b91f-d74d-498d-aede-ce9c4d8a6250]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9501a5ab-5016-4f67-a884-0e9cb6a08fb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:11:11 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5807a2-a399-4315-bc64-511230b90ec1]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.utils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating existing volume attachment record: 8e7ba579-7731-4ae4-a4e5-28f0aa226843 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b,backing_fmt=raw /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b,backing_fmt=raw /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue" returned: 0 in 0.049s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "ec228d9e10511f5632fbe2b364b7664bc57ce55b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'migration_context' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<1e8d0ac5-6125-425f-808c-f540f57ebc5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start _get_guest_xml network_info=[{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:1c:e0:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '103f063a-8234-41b9-8b56-dfe71520f7a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1e8d0ac5-6125-425f-808c-f540f57ebc5d', 'attached_at': '', 'detached_at': '', 'volume_id': '7e39473d-2111-4332-8489-2498186b2973', 'serial': '7e39473d-2111-4332-8489-2498186b2973'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '71550093-3fa6-4885-bda9-4b74d7ce3128', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<1e8d0ac5-6125-425f-808c-f540f57ebc5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<1e8d0ac5-6125-425f-808c-f540f57ebc5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.objects.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<1e8d0ac5-6125-425f-808c-f540f57ebc5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:11:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:11:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:11:13 user nova-compute[75279]: INFO nova.compute.claims [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Claim successful on node user
Nov 11 00:11:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e562a-c747-4aac-8c9d-56ea3a68e67b]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:11:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:11:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:11:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Creating image(s)
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "/opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "/opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "/opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.policy [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba76aa79464c4b0d8f8866630b07e332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ece3759ebf543dc8614b4ed2dd57763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwKksNJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 5.559s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] <== connect_volume: return (5563ms) {'type': 'block', 'scsi_wwn': '23832336661383635', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832336661383635', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.559s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:14 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:11:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'flavor' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4e79c-116b-4fd9-a905-d44bc56b4d1b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sERMGNZH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 11 00:11:14 user nova-compute[75279]: node.name = iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:11:14 user nova-compute[75279]: node.tpgt = -1
Nov 11 00:11:14 user nova-compute[75279]: node.startup = automatic
Nov 11 00:11:14 user nova-compute[75279]: node.leading_login = No
Nov 11 00:11:14 user nova-compute[75279]: iface.iscsi_ifacename = default
Nov 11 00:11:14 user nova-compute[75279]: iface.net_ifacename = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.ipaddress = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.prefix_len = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.hwaddress = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.transport_name = tcp
Nov 11 00:11:14 user nova-compute[75279]: iface.initiatorname = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.vlan_id = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.vlan_priority = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.vlan_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.iface_num = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.mtu = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.port = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.bootproto = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.subnet_mask = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.gateway = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_alt_client_id_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_alt_client_id = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_dns = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_learn_iqn = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_req_vendor_id_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_vendor_id_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_vendor_id = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.dhcp_slp_da = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.fragmentation = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.gratuitous_arp = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.incoming_forwarding = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.tos_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.tos = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.ttl = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.delayed_ack = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.tcp_nagle = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.tcp_wsf_state = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.tcp_wsf = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.tcp_timer_scale = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.tcp_timestamp = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.redirect = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.def_task_mgmt_timeout = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.header_digest = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.data_digest = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.immediate_data = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.initial_r2t = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.data_seq_inorder = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.data_pdu_inorder = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.erl = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.max_receive_data_len = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.first_burst_len = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.max_outstanding_r2t = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.max_burst_len = 0
Nov 11 00:11:14 user nova-compute[75279]: iface.chap_auth = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.bidi_chap = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.strict_login_compliance = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.discovery_auth = <empty>
Nov 11 00:11:14 user nova-compute[75279]: iface.discovery_logout = <empty>
Nov 11 00:11:14 user nova-compute[75279]: node.discovery_address = <empty>
Nov 11 00:11:14 user nova-compute[75279]: node.discovery_port = 0
Nov 11 00:11:14 user nova-compute[75279]: node.discovery_type = static
Nov 11 00:11:14 user nova-compute[75279]: node.session.initial_cmdsn = 0
Nov 11 00:11:14 user nova-compute[75279]: node.session.initial_login_retry_max = 8
Nov 11 00:11:14 user nova-compute[75279]: node.session.xmit_thread_priority = -20
Nov 11 00:11:14 user nova-compute[75279]: node.session.cmds_max = 128
Nov 11 00:11:14 user nova-compute[75279]: node.session.queue_depth = 32
Nov 11 00:11:14 user nova-compute[75279]: node.session.nr_sessions = 1
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.authmethod = CHAP
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.username = sERMGNZH
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.password = ***
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.username_in = <empty>
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.password_in = <empty>
Nov 11 00:11:14 user nova-compute[75279]: node.session.auth.chap_algs = MD5
Nov 11 00:11:14 user nova-compute[75279]: node.session.timeo.replacement_timeout = 120
Nov 11 00:11:14 user nova-compute[75279]: node.session.err_timeo.abort_timeout = 15
Nov 11 00:11:14 user nova-compute[75279]: node.session.err_timeo.lu_reset_timeout = 30
Nov 11 00:11:14 user nova-compute[75279]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 11 00:11:14 user nova-compute[75279]: node.session.err_timeo.host_reset_timeout = 60
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.FastAbort = Yes
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.InitialR2T = No
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.ImmediateData = Yes
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.FirstBurstLength = 262144
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.MaxBurstLength = 16776192
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.DefaultTime2Retain = 0
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.DefaultTime2Wait = 2
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.MaxConnections = 1
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 11 00:11:14 user nova-compute[75279]: node.session.iscsi.ERL = 0
Nov 11 00:11:14 user nova-compute[75279]: node.session.scan = manual
Nov 11 00:11:14 user nova-compute[75279]: node.session.reopen_max = 0
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].address = 172.16.0.220
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].port = 3260
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].startup = manual
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].tcp.window_size = 524288
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].tcp.type_of_service = 0
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].timeo.logout_timeout = 15
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].timeo.login_timeout = 15
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].timeo.auth_timeout = 45
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].timeo.noop_out_interval = 5
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].timeo.noop_out_timeout = 5
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.HeaderDigest = None
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.DataDigest = None
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.IFMarker = No
Nov 11 00:11:14 user nova-compute[75279]: node.conn[0].iscsi.OFMarker = No
Nov 11 00:11:14 user nova-compute[75279]: # END RECORD
Nov 11 00:11:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:11:14 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:11:14 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:11:14 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:11:14 user nova-compute[75279]:   <serial>e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c</serial>
Nov 11 00:11:14 user nova-compute[75279]: </disk>
Nov 11 00:11:14 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[87108033-df12-456d-b202-8d0a056f3e4a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27740fa-b251-40ee-8e98-48a67c3af6a9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sERMGNZH {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk 1073741824" returned: 0 in 0.115s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sERMGNZH" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb0979-646b-4a6a-94c3-ff22c8d94bd2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sERMGNZH'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cfa204-6c40-41ba-b32f-eccd090c6848]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1634311-230d-4b0f-84a6-2e7950f05f32]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:14 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:14 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:14 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:14 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] HCTL ('34', '0', '0', 0) found on session 22 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6bf6c-aee6-4caf-9028-7d498745990a]: (4, ('0 0 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching for a device in session 22 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.347s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== connect_volume: return (2907ms) {'type': 'block', 'scsi_wwn': '26638386266353163', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638386266353163', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-553191854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-553191854',id=20,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ggghjtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:10:03Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=1e8d0ac5-6125-425f-808c-f540f57ebc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:1c:e0:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:1c:e0:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.objects.base [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<1e8d0ac5-6125-425f-808c-f540f57ebc5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:11:14 user nova-compute[75279]:   <uuid>1e8d0ac5-6125-425f-808c-f540f57ebc5d</uuid>
Nov 11 00:11:14 user nova-compute[75279]:   <name>instance-00000014</name>
Nov 11 00:11:14 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:11:14 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:11:14 user nova-compute[75279]:   <metadata>
Nov 11 00:11:14 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:11:14 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-553191854</nova:name>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:11:11</nova:creationTime>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:11:14 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:11:14 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:owner>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:11:14 user nova-compute[75279]:       </nova:owner>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:11:14 user nova-compute[75279]:       <nova:ports>
Nov 11 00:11:14 user nova-compute[75279]:         <nova:port uuid="4439a833-cca8-4f9b-ad1f-f6684b2af4b9">
Nov 11 00:11:14 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:11:14 user nova-compute[75279]:         </nova:port>
Nov 11 00:11:14 user nova-compute[75279]:       </nova:ports>
Nov 11 00:11:14 user nova-compute[75279]:     </nova:instance>
Nov 11 00:11:14 user nova-compute[75279]:   </metadata>
Nov 11 00:11:14 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:11:14 user nova-compute[75279]:     <system>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="serial">1e8d0ac5-6125-425f-808c-f540f57ebc5d</entry>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="uuid">1e8d0ac5-6125-425f-808c-f540f57ebc5d</entry>
Nov 11 00:11:14 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:11:14 user nova-compute[75279]:     </system>
Nov 11 00:11:14 user nova-compute[75279]:   </sysinfo>
Nov 11 00:11:14 user nova-compute[75279]:   <os>
Nov 11 00:11:14 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:11:14 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:11:14 user nova-compute[75279]:   </os>
Nov 11 00:11:14 user nova-compute[75279]:   <features>
Nov 11 00:11:14 user nova-compute[75279]:     <acpi/>
Nov 11 00:11:14 user nova-compute[75279]:     <apic/>
Nov 11 00:11:14 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:11:14 user nova-compute[75279]:   </features>
Nov 11 00:11:14 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:11:14 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:11:14 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:11:14 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:11:14 user nova-compute[75279]:   </clock>
Nov 11 00:11:14 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:11:14 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:11:14 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:11:14 user nova-compute[75279]:   </cpu>
Nov 11 00:11:14 user nova-compute[75279]:   <devices>
Nov 11 00:11:14 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:11:14 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:11:14 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:11:14 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:11:14 user nova-compute[75279]:       <serial>7e39473d-2111-4332-8489-2498186b2973</serial>
Nov 11 00:11:14 user nova-compute[75279]:     </disk>
Nov 11 00:11:14 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:11:14 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:11:14 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue"/>
Nov 11 00:11:14 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:11:14 user nova-compute[75279]:       <boot order="1"/>
Nov 11 00:11:14 user nova-compute[75279]:     </disk>
Nov 11 00:11:14 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:11:14 user nova-compute[75279]:       <mac address="fa:16:3e:1c:e0:58"/>
Nov 11 00:11:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:14 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:11:14 user nova-compute[75279]:       <target dev="tap4439a833-cc"/>
Nov 11 00:11:14 user nova-compute[75279]:     </interface>
Nov 11 00:11:14 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:11:14 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/console.log" append="off"/>
Nov 11 00:11:14 user nova-compute[75279]:     </serial>
Nov 11 00:11:14 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:11:14 user nova-compute[75279]:     <video>
Nov 11 00:11:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:14 user nova-compute[75279]:     </video>
Nov 11 00:11:14 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:11:14 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:11:14 user nova-compute[75279]:     </rng>
Nov 11 00:11:14 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:11:14 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:11:14 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:11:14 user nova-compute[75279]:     </memballoon>
Nov 11 00:11:14 user nova-compute[75279]:   </devices>
Nov 11 00:11:14 user nova-compute[75279]: </domain>
Nov 11 00:11:14 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:11:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance destroyed successfully.
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Successfully created port: e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:1c:e0:58, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Cannot resize image /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Ensure instance console log exists: /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:c6:03:ab, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:11:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1823e755-c5cd-4c3f-bf7a-1aba2a497ae2 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.987s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Successfully updated port: e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquired lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-changed-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Refreshing instance network info cache due to event network-changed-e4899405-99b5-4dea-a45f-6a7a37a89588. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] Acquiring lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updating instance_info_cache with network_info: [{"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Releasing lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Instance network_info: |[{"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] Acquired lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Refreshing network info cache for port e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Start _get_guest_xml network_info=[{"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:11:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1739322803',display_name='tempest-VolumesSnapshotTestJSON-instance-1739322803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1739322803',id=23,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpAZan/ac5iVv5iImLhpYf36xof/1VOdfIzksKKSurpCsfrSD8ig4gIIN90mUxFXfrPWRwh3CGuab9HdcndKkhoAUPzoI8rzgUNjN+o0B0+gQhQx6oIZHemtJ7RWIPDKg==',key_name='tempest-keypair-2065316520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-f0yw524s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=07457a5e-5ed9-4d25-8218-aabe1c4689ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'pci_devices' on Instance uuid 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:11:16 user nova-compute[75279]:   <uuid>07457a5e-5ed9-4d25-8218-aabe1c4689ae</uuid>
Nov 11 00:11:16 user nova-compute[75279]:   <name>instance-00000017</name>
Nov 11 00:11:16 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:11:16 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:11:16 user nova-compute[75279]:   <metadata>
Nov 11 00:11:16 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:11:16 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1739322803</nova:name>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:11:16</nova:creationTime>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:11:16 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:11:16 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:owner>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:user uuid="ba76aa79464c4b0d8f8866630b07e332">tempest-VolumesSnapshotTestJSON-567109824-project-member</nova:user>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:project uuid="2ece3759ebf543dc8614b4ed2dd57763">tempest-VolumesSnapshotTestJSON-567109824</nova:project>
Nov 11 00:11:16 user nova-compute[75279]:       </nova:owner>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:11:16 user nova-compute[75279]:       <nova:ports>
Nov 11 00:11:16 user nova-compute[75279]:         <nova:port uuid="e4899405-99b5-4dea-a45f-6a7a37a89588">
Nov 11 00:11:16 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 00:11:16 user nova-compute[75279]:         </nova:port>
Nov 11 00:11:16 user nova-compute[75279]:       </nova:ports>
Nov 11 00:11:16 user nova-compute[75279]:     </nova:instance>
Nov 11 00:11:16 user nova-compute[75279]:   </metadata>
Nov 11 00:11:16 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:11:16 user nova-compute[75279]:     <system>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="serial">07457a5e-5ed9-4d25-8218-aabe1c4689ae</entry>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="uuid">07457a5e-5ed9-4d25-8218-aabe1c4689ae</entry>
Nov 11 00:11:16 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:11:16 user nova-compute[75279]:     </system>
Nov 11 00:11:16 user nova-compute[75279]:   </sysinfo>
Nov 11 00:11:16 user nova-compute[75279]:   <os>
Nov 11 00:11:16 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:11:16 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:11:16 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:11:16 user nova-compute[75279]:   </os>
Nov 11 00:11:16 user nova-compute[75279]:   <features>
Nov 11 00:11:16 user nova-compute[75279]:     <acpi/>
Nov 11 00:11:16 user nova-compute[75279]:     <apic/>
Nov 11 00:11:16 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:11:16 user nova-compute[75279]:   </features>
Nov 11 00:11:16 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:11:16 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:11:16 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:11:16 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:11:16 user nova-compute[75279]:   </clock>
Nov 11 00:11:16 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:11:16 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:11:16 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:11:16 user nova-compute[75279]:   </cpu>
Nov 11 00:11:16 user nova-compute[75279]:   <devices>
Nov 11 00:11:16 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:11:16 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:11:16 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk"/>
Nov 11 00:11:16 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:11:16 user nova-compute[75279]:     </disk>
Nov 11 00:11:16 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:11:16 user nova-compute[75279]:       <mac address="fa:16:3e:2d:4d:d4"/>
Nov 11 00:11:16 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:16 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:11:16 user nova-compute[75279]:       <target dev="tape4899405-99"/>
Nov 11 00:11:16 user nova-compute[75279]:     </interface>
Nov 11 00:11:16 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:11:16 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/console.log" append="off"/>
Nov 11 00:11:16 user nova-compute[75279]:     </serial>
Nov 11 00:11:16 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:11:16 user nova-compute[75279]:     <video>
Nov 11 00:11:16 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:16 user nova-compute[75279]:     </video>
Nov 11 00:11:16 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:11:16 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:11:16 user nova-compute[75279]:     </rng>
Nov 11 00:11:16 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:11:16 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:11:16 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:11:16 user nova-compute[75279]:     </memballoon>
Nov 11 00:11:16 user nova-compute[75279]:   </devices>
Nov 11 00:11:16 user nova-compute[75279]: </domain>
Nov 11 00:11:16 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1739322803',display_name='tempest-VolumesSnapshotTestJSON-instance-1739322803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1739322803',id=23,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpAZan/ac5iVv5iImLhpYf36xof/1VOdfIzksKKSurpCsfrSD8ig4gIIN90mUxFXfrPWRwh3CGuab9HdcndKkhoAUPzoI8rzgUNjN+o0B0+gQhQx6oIZHemtJ7RWIPDKg==',key_name='tempest-keypair-2065316520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-f0yw524s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=07457a5e-5ed9-4d25-8218-aabe1c4689ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG os_vif [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6959ce6a-e624-5b08-84fc-853bc63611a6', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:16 user nova-compute[75279]: WARNING nova.compute.manager [req-57730a9b-e01f-4fd3-ba08-409797bffc94 req-956a000c-61d4-4577-bbee-2e2ee992002b service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state rescuing.
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4899405-99, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4899405-99, col_values=(('qos', UUID('7cef527b-9352-4233-994d-5be7e8927f0b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4899405-99, col_values=(('external_ids', {'iface-id': 'e4899405-99b5-4dea-a45f-6a7a37a89588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:4d:d4', 'vm-uuid': '07457a5e-5ed9-4d25-8218-aabe1c4689ae'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: INFO os_vif [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99')
Nov 11 00:11:16 user nova-compute[75279]: INFO nova.compute.manager [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Rescuing
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No VIF found with MAC fa:16:3e:2d:4d:d4, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updated VIF entry in instance network info cache for port e4899405-99b5-4dea-a45f-6a7a37a89588. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updating instance_info_cache with network_info: [{"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-848cc06d-b712-4199-a89a-130ac269845c req-96f02c61-5830-4e4b-955a-d87bba5e2835 service nova] Releasing lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:18 user nova-compute[75279]: WARNING nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state active and task_state rescuing.
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:18 user nova-compute[75279]: WARNING nova.compute.manager [req-bed7b90d-749a-454f-9b6c-0843019b8ec5 req-11585235-3b5c-4fe4-b410-c8855867ff2b service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state active and task_state rescuing.
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:18 user nova-compute[75279]: WARNING nova.compute.manager [req-57811b5f-9ab1-417f-b44f-c4bd1e144b17 req-229c0624-6e66-4f5b-816d-eedc280d97ab service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state building and task_state spawning.
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:18 user nova-compute[75279]: WARNING nova.compute.manager [req-0d520178-b0a4-4914-b8fb-641791512518 req-f26404b8-7ac6-485e-8df5-2fb97fea9bd2 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state rescuing.
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance destroyed successfully.
Nov 11 00:11:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Attempting rescue
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:11:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Creating image(s)
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue" returned: 0 in 0.055s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'migration_context' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.base [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<e3ca7730-9c3a-430e-83bd-500aac5a7d7b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start _get_guest_xml network_info=[{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:c6:03:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.base [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<e3ca7730-9c3a-430e-83bd-500aac5a7d7b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'numa_topology' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.base [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<e3ca7730-9c3a-430e-83bd-500aac5a7d7b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:19 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:19 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.base [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<e3ca7730-9c3a-430e-83bd-500aac5a7d7b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1121013036',display_name='tempest-ServerRescueNegativeTestJSON-server-1121013036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1121013036',id=19,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtSClAvXtKr6JVW5NihJfFVYFdhstg4smHU7qUBqjmt2NH5LJuvPb2M70olryln7+NEi/su0iyugOlAg03uS7EgMms9+UuREHZ4+KEqGcR0pFYtRctX9lbsVyzFeM74HA==',key_name='tempest-keypair-1990191476',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-703kr6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=e3ca7730-9c3a-430e-83bd-500aac5a7d7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:c6:03:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "vif_mac": "fa:16:3e:c6:03:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'pci_devices' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.objects.base [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Object Instance<e3ca7730-9c3a-430e-83bd-500aac5a7d7b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:11:19 user nova-compute[75279]:   <uuid>e3ca7730-9c3a-430e-83bd-500aac5a7d7b</uuid>
Nov 11 00:11:19 user nova-compute[75279]:   <name>instance-00000013</name>
Nov 11 00:11:19 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:11:19 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:11:19 user nova-compute[75279]:   <metadata>
Nov 11 00:11:19 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:11:19 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1121013036</nova:name>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:11:19</nova:creationTime>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:11:19 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:11:19 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:owner>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:user uuid="818b35f397a6467f8dec8eb37cef2ed7">tempest-ServerRescueNegativeTestJSON-948684747-project-member</nova:user>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:project uuid="2918206b132a4855a996eac99bbf5706">tempest-ServerRescueNegativeTestJSON-948684747</nova:project>
Nov 11 00:11:19 user nova-compute[75279]:       </nova:owner>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:11:19 user nova-compute[75279]:       <nova:ports>
Nov 11 00:11:19 user nova-compute[75279]:         <nova:port uuid="d2b67918-8939-4890-ba8f-0001db5ba09b">
Nov 11 00:11:19 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:11:19 user nova-compute[75279]:         </nova:port>
Nov 11 00:11:19 user nova-compute[75279]:       </nova:ports>
Nov 11 00:11:19 user nova-compute[75279]:     </nova:instance>
Nov 11 00:11:19 user nova-compute[75279]:   </metadata>
Nov 11 00:11:19 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:11:19 user nova-compute[75279]:     <system>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="serial">e3ca7730-9c3a-430e-83bd-500aac5a7d7b</entry>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="uuid">e3ca7730-9c3a-430e-83bd-500aac5a7d7b</entry>
Nov 11 00:11:19 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:11:19 user nova-compute[75279]:     </system>
Nov 11 00:11:19 user nova-compute[75279]:   </sysinfo>
Nov 11 00:11:19 user nova-compute[75279]:   <os>
Nov 11 00:11:19 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:11:19 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:11:19 user nova-compute[75279]:   </os>
Nov 11 00:11:19 user nova-compute[75279]:   <features>
Nov 11 00:11:19 user nova-compute[75279]:     <acpi/>
Nov 11 00:11:19 user nova-compute[75279]:     <apic/>
Nov 11 00:11:19 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:11:19 user nova-compute[75279]:   </features>
Nov 11 00:11:19 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:11:19 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:11:19 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:11:19 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:11:19 user nova-compute[75279]:   </clock>
Nov 11 00:11:19 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:11:19 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:11:19 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:11:19 user nova-compute[75279]:   </cpu>
Nov 11 00:11:19 user nova-compute[75279]:   <devices>
Nov 11 00:11:19 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:11:19 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:11:19 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue"/>
Nov 11 00:11:19 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:11:19 user nova-compute[75279]:     </disk>
Nov 11 00:11:19 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:11:19 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:11:19 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk"/>
Nov 11 00:11:19 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:11:19 user nova-compute[75279]:     </disk>
Nov 11 00:11:19 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:11:19 user nova-compute[75279]:       <mac address="fa:16:3e:c6:03:ab"/>
Nov 11 00:11:19 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:19 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:11:19 user nova-compute[75279]:       <target dev="tapd2b67918-89"/>
Nov 11 00:11:19 user nova-compute[75279]:     </interface>
Nov 11 00:11:19 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:11:19 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/console.log" append="off"/>
Nov 11 00:11:19 user nova-compute[75279]:     </serial>
Nov 11 00:11:19 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:11:19 user nova-compute[75279]:     <video>
Nov 11 00:11:19 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:19 user nova-compute[75279]:     </video>
Nov 11 00:11:19 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:11:19 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:11:19 user nova-compute[75279]:     </rng>
Nov 11 00:11:19 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:11:19 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:11:19 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:11:19 user nova-compute[75279]:     </memballoon>
Nov 11 00:11:19 user nova-compute[75279]:   </devices>
Nov 11 00:11:19 user nova-compute[75279]: </domain>
Nov 11 00:11:19 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:11:19 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance destroyed successfully.
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] No VIF found with MAC fa:16:3e:c6:03:ab, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:20 user nova-compute[75279]: WARNING nova.compute.manager [req-a8789203-f866-4705-8e15-01f988523904 req-e7edd47f-204c-4667-9b00-df892af4636b service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state building and task_state spawning.
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-78c35486-8223-4d93-bdbf-582558850765 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:11:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Instance spawned successfully.
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:21 user nova-compute[75279]: INFO nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 11 00:11:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:21 user nova-compute[75279]: WARNING nova.compute.manager [req-55063d13-37f9-4396-a24b-a0564d27d6fe req-a68b74d0-8b0d-4de3-afb0-c667de643b93 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state active and task_state rescuing.
Nov 11 00:11:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:21 user nova-compute[75279]: INFO nova.compute.manager [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Took 7.99 seconds to build instance.
Nov 11 00:11:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21aa209d-7870-4dfb-b9e2-92f9580ed57b tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.127s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:23 user nova-compute[75279]: WARNING nova.compute.manager [req-c9430192-f18b-4d7c-83eb-9bc9d329cdc8 req-0e5360fa-e1ec-45ca-b3c7-02edf218e8ac service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state active and task_state rescuing.
Nov 11 00:11:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c264ead2-97d5-46ef-aa6f-96cac94df975 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:11:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:24 user nova-compute[75279]: INFO nova.compute.manager [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Detaching volume e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:11:24 user nova-compute[75279]: INFO nova.virt.block_device [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Attempting to driver detach volume e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd from mountpoint /dev/vdb
Nov 11 00:11:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Attempting to detach device vdb from instance cf144ba3-c7c9-4a61-91a5-4d463262af48 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:11:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:11:24 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:11:24 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:11:24 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:11:24 user nova-compute[75279]:   <serial>e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd</serial>
Nov 11 00:11:24 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:11:24 user nova-compute[75279]: </disk>
Nov 11 00:11:24 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:11:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance cf144ba3-c7c9-4a61-91a5-4d463262af48 from the persistent domain config.
Nov 11 00:11:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf144ba3-c7c9-4a61-91a5-4d463262af48 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:11:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:11:24 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:11:24 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:11:24 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:11:24 user nova-compute[75279]:   <serial>e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd</serial>
Nov 11 00:11:24 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:11:24 user nova-compute[75279]: </disk>
Nov 11 00:11:24 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:11:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:11:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:27 user nova-compute[75279]: INFO nova.compute.manager [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Terminating instance
Nov 11 00:11:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-f8b23073-f3f6-4e10-a1e8-00f64c185afe req-5b6ff002-103a-4992-a72e-6ce67766584c service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-unplugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Instance destroyed successfully.
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.objects.instance [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'resources' on Instance uuid 83af4515-8148-461e-9682-9c5917ad61ea {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-530644997',display_name='tempest-AttachVolumeTestJSON-server-530644997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-530644997',id=2,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQdMlXwLlAO5QLSXrhGxtSy2+xPa2jDSwCr4PU73f+aKWBDyztjYM0upvCKzH9+mtepSa9jejy3fS3EdSwXbESxSYgjNxTXQiQBXk0R/DwCkXOwH7tNZ0GE/e7zy2+UgA==',key_name='tempest-keypair-633715215',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-akgspkvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=83af4515-8148-461e-9682-9c5917ad61ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "c2af150b-6845-4dba-95c9-897b82ee2715", "address": "fa:16:3e:9d:b7:6d", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2af150b-68", "ovs_interfaceid": "c2af150b-6845-4dba-95c9-897b82ee2715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG os_vif [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2af150b-68, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92f31478-f7de-477e-a1d4-e141a2876fde) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:28 user nova-compute[75279]: INFO os_vif [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b7:6d,bridge_name='br-int',has_traffic_filtering=True,id=c2af150b-6845-4dba-95c9-897b82ee2715,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2af150b-68')
Nov 11 00:11:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Deleting instance files /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea_del
Nov 11 00:11:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Deletion of /opt/stack/data/nova/instances/83af4515-8148-461e-9682-9c5917ad61ea_del complete
Nov 11 00:11:28 user nova-compute[75279]: INFO nova.compute.manager [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 11 00:11:28 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:11:28 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:29 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Took 0.84 seconds to deallocate network for instance.
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-434da128-3624-4c19-9300-a35c9c9a3a8a req-77df06da-b1c8-4428-80d4-e1ab4137aeb4 service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-deleted-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] Acquiring lock "83af4515-8148-461e-9682-9c5917ad61ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] Lock "83af4515-8148-461e-9682-9c5917ad61ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] No waiting events found dispatching network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:29 user nova-compute[75279]: WARNING nova.compute.manager [req-48ba0ead-a068-4d0e-8b04-69971f461ef1 req-29458e67-a5bf-4156-8d31-d7c2dea4d17f service nova] [instance: 83af4515-8148-461e-9682-9c5917ad61ea] Received unexpected event network-vif-plugged-c2af150b-6845-4dba-95c9-897b82ee2715 for instance with vm_state deleted and task_state None.
Nov 11 00:11:29 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.765s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:30 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Deleted allocations for instance 83af4515-8148-461e-9682-9c5917ad61ea
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-08b85c63-1016-45a3-b644-0a354aafd9eb tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "83af4515-8148-461e-9682-9c5917ad61ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:11:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.283580780029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 508cd740-432b-433c-803f-da3892a04d48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:11:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:11:36 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:11:36 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:11:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:11:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:11:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [{"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-cf144ba3-c7c9-4a61-91a5-4d463262af48" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:11:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Releasing lock "ea374667-4ec1-4242-8838-a0ab8cff08b0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:11:40 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Creating image(s)
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Ensure instance console log exists: /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start _get_guest_xml network_info=[{"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '508cd740-432b-433c-803f-da3892a04d48', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'serial': 'b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '8e7ba579-7731-4ae4-a4e5-28f0aa226843', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:11:40 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 00:11:40 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lazy-loading 'vcpu_model' on Instance uuid 508cd740-432b-433c-803f-da3892a04d48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:11:40 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:40 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:40 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d76e77-6e45-4e99-a691-7180875eb512]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:11:40 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[496f8aa1-9a51-4b84-8bae-d31e7e3be237]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e] added
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713cd0c-818d-4c9f-8a2d-f97fbec0ef79]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55630b7-2582-4c9c-aa55-edada75d2895]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVAcJKBN {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVAcJKBN" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b545bb-7afd-4c59-8dba-6fc7a7817416]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVAcJKBN'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60425d6-058b-46d0-9411-e7af9601c93a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ab2a0-82ee-4bf2-bac8-2d4eaa74ecc8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560cb3b-d929-413c-ac8e-854d2e6e1a36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]
Nov 11 00:11:40 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169344a-a302-4dce-9df0-d6292bff58a2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[402e0f76-343e-40a7-bb31-8223f54493ba]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:40 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:11:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c8699-2cd8-4004-a7c4-8ed16660cf99]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:11:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23266343037643864', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266343037643864', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1302584730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:11:41 user nova-compute[75279]:   <uuid>508cd740-432b-433c-803f-da3892a04d48</uuid>
Nov 11 00:11:41 user nova-compute[75279]:   <name>instance-00000011</name>
Nov 11 00:11:41 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:11:41 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:11:41 user nova-compute[75279]:   <metadata>
Nov 11 00:11:41 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:11:41 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:11:41 user nova-compute[75279]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1302584730</nova:name>
Nov 11 00:11:41 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:11:40</nova:creationTime>
Nov 11 00:11:41 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:11:41 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:11:41 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:11:41 user nova-compute[75279]:       <nova:owner>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:user uuid="3fe0334c76ab4a77819bb11e42e3ba3a">tempest-ServerActionsV293TestJSON-1040260601-project-member</nova:user>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:project uuid="280c69c91fb040f79bd21c7bd89672ac">tempest-ServerActionsV293TestJSON-1040260601</nova:project>
Nov 11 00:11:41 user nova-compute[75279]:       </nova:owner>
Nov 11 00:11:41 user nova-compute[75279]:       <nova:ports>
Nov 11 00:11:41 user nova-compute[75279]:         <nova:port uuid="f948b442-834c-45b5-a217-e97f753b968d">
Nov 11 00:11:41 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 00:11:41 user nova-compute[75279]:         </nova:port>
Nov 11 00:11:41 user nova-compute[75279]:       </nova:ports>
Nov 11 00:11:41 user nova-compute[75279]:     </nova:instance>
Nov 11 00:11:41 user nova-compute[75279]:   </metadata>
Nov 11 00:11:41 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:11:41 user nova-compute[75279]:     <system>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="serial">508cd740-432b-433c-803f-da3892a04d48</entry>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="uuid">508cd740-432b-433c-803f-da3892a04d48</entry>
Nov 11 00:11:41 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:11:41 user nova-compute[75279]:     </system>
Nov 11 00:11:41 user nova-compute[75279]:   </sysinfo>
Nov 11 00:11:41 user nova-compute[75279]:   <os>
Nov 11 00:11:41 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:11:41 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:11:41 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:11:41 user nova-compute[75279]:   </os>
Nov 11 00:11:41 user nova-compute[75279]:   <features>
Nov 11 00:11:41 user nova-compute[75279]:     <acpi/>
Nov 11 00:11:41 user nova-compute[75279]:     <apic/>
Nov 11 00:11:41 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:11:41 user nova-compute[75279]:   </features>
Nov 11 00:11:41 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:11:41 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:11:41 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:11:41 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:11:41 user nova-compute[75279]:   </clock>
Nov 11 00:11:41 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:11:41 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:11:41 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:11:41 user nova-compute[75279]:   </cpu>
Nov 11 00:11:41 user nova-compute[75279]:   <devices>
Nov 11 00:11:41 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:11:41 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:11:41 user nova-compute[75279]:       <source dev="/dev/sde"/>
Nov 11 00:11:41 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:11:41 user nova-compute[75279]:       <serial>b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e</serial>
Nov 11 00:11:41 user nova-compute[75279]:     </disk>
Nov 11 00:11:41 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:11:41 user nova-compute[75279]:       <mac address="fa:16:3e:f7:47:51"/>
Nov 11 00:11:41 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:41 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:11:41 user nova-compute[75279]:       <target dev="tapf948b442-83"/>
Nov 11 00:11:41 user nova-compute[75279]:     </interface>
Nov 11 00:11:41 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:11:41 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48/console.log" append="off"/>
Nov 11 00:11:41 user nova-compute[75279]:     </serial>
Nov 11 00:11:41 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:11:41 user nova-compute[75279]:     <video>
Nov 11 00:11:41 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:11:41 user nova-compute[75279]:     </video>
Nov 11 00:11:41 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:11:41 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:11:41 user nova-compute[75279]:     </rng>
Nov 11 00:11:41 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:11:41 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:11:41 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:11:41 user nova-compute[75279]:     </memballoon>
Nov 11 00:11:41 user nova-compute[75279]:   </devices>
Nov 11 00:11:41 user nova-compute[75279]: </domain>
Nov 11 00:11:41 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1302584730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG os_vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15ba18c5-e75b-57a4-94cd-138c9781491a', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf948b442-83, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf948b442-83, col_values=(('qos', UUID('a4c12ee9-2568-49de-a108-7edfcc692809')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf948b442-83, col_values=(('external_ids', {'iface-id': 'f948b442-834c-45b5-a217-e97f753b968d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:47:51', 'vm-uuid': '508cd740-432b-433c-803f-da3892a04d48'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:41 user nova-compute[75279]: INFO os_vif [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83')
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] No VIF found with MAC fa:16:3e:f7:47:51, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:11:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:43 user nova-compute[75279]: WARNING nova.compute.manager [req-dcf4b4d2-1828-4b63-a979-fd0b24709f7e req-0f127c91-e32c-40c4-9d90-16e04db37d66 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state active and task_state rebuild_spawning.
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:11:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance spawned successfully.
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:11:45 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf144ba3-c7c9-4a61-91a5-4d463262af48 is timed out.
Nov 11 00:11:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance cf144ba3-c7c9-4a61-91a5-4d463262af48 from the live domain config.
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANYkIyFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:11:45 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.016s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e137991c-cd87-4aaf-8889-f7227fa08dd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:11:45 user nova-compute[75279]: No targets found.
Nov 11 00:11:45 user nova-compute[75279]: iSNS:
Nov 11 00:11:45 user nova-compute[75279]: No targets found.
Nov 11 00:11:45 user nova-compute[75279]: STATIC:
Nov 11 00:11:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:11:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:11:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:11:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:11:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:11:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:11:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:11:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:11:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:11:45 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd
Nov 11 00:11:45 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:11:45 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:11:45 user nova-compute[75279]: FIRMWARE:
Nov 11 00:11:45 user nova-compute[75279]: No targets found.
Nov 11 00:11:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:11:45 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:11:45 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435727d-7016-4966-949b-13a19660268d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:11:45 user nova-compute[75279]: WARNING nova.compute.manager [req-7ba19f9a-6120-4420-bf1d-b8bcc85ca452 req-b064aa2a-98e2-419e-98a5-cce9e026398a service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state active and task_state rebuild_spawning.
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4908a8e4-8b04-4d60-9ddd-56c22d8819f0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:11:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:11:45 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:11:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e02af130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39aadd6-5740-4ac3-9eab-c6e6a61200d0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5141b1-019f-4da6-96ba-35d3c4b47ef3]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe265bb-5b10-451e-8470-89d62f14df92]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[215b5ab4-535d-4614-837d-ecb14a5d1300]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75279) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e059e69-a242-49c7-be17-f71ed3b8eb3a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c163b-a3ed-4904-815f-1373a28632f8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260]
Nov 11 00:11:45 user nova-compute[75279]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd, portal: 172.16.0.220,3260] successful.
Nov 11 00:11:45 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b8e4c8c5-f3d6-4e8a-a9e3-387fa760b0a4 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52c7ee0-6ec7-4d4d-bdd9-dfda5bc01ecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f0eacc-eca2-4ed3-aa37-743ecef3c2ad]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== disconnect_volume: return (458ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:11:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:11:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:11:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-43667010-9c58-4edf-b913-be504c1c50a5 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.481s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:11:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:11:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing instance network info cache due to event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updated VIF entry in instance network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a3366dc5-4906-4608-9028-fd874dbc2b7c req-c08c3072-17b2-40d7-a289-eb5f50ce1776 service nova] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:12:13 user nova-compute[75279]: INFO nova.compute.manager [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] instance snapshotting
Nov 11 00:12:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Beginning live snapshot process
Nov 11 00:12:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704.delta 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704.delta 1073741824" returned: 0 in 0.056s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:14 user nova-compute[75279]: INFO nova.compute.manager [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Terminating instance
Nov 11 00:12:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-unplugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] No waiting events found dispatching network-vif-unplugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-f2c4ba01-361c-4b7b-aeac-8f9735b4f20b req-a1964f7a-4f50-46ba-aa69-7a9c16def836 service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-unplugged-b9e08345-100c-4075-a847-c73c1d8a3c85 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:12:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Instance destroyed successfully.
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'resources' on Instance uuid cf144ba3-c7c9-4a61-91a5-4d463262af48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704.delta /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1802379478',display_name='tempest-AttachVolumeNegativeTest-server-1802379478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1802379478',id=15,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2aroIfjaXYkQK42vG6vZnyDF+fK0sxOCXSXBmZqpSpiMiOHx3RNvQsZ2GFc1NvTLJXuf8NK+tCzs2JVXWjhtdDNuzCnEvfeS3q/NBqAsJiGsb31XyUYpf3oNXv+NAfVg==',key_name='tempest-keypair-79256428',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-p5p1dx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=cf144ba3-c7c9-4a61-91a5-4d463262af48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "b9e08345-100c-4075-a847-c73c1d8a3c85", "address": "fa:16:3e:dd:86:c2", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e08345-10", "ovs_interfaceid": "b9e08345-100c-4075-a847-c73c1d8a3c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG os_vif [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9e08345-10, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=074ee793-370e-4856-aea8-67901c33af8f) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:15 user nova-compute[75279]: INFO os_vif [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9e08345-100c-4075-a847-c73c1d8a3c85,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e08345-10')
Nov 11 00:12:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Deleting instance files /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48_del
Nov 11 00:12:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Deletion of /opt/stack/data/nova/instances/cf144ba3-c7c9-4a61-91a5-4d463262af48_del complete
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-changed-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing instance network info cache due to event network-changed-72682323-e45b-4a04-9e61-06dbe1924488. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:15 user nova-compute[75279]: DEBUG nova.network.neutron [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing network info cache for port 72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:12:16 user nova-compute[75279]: INFO nova.compute.manager [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 11 00:12:16 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704.delta /opt/stack/data/nova/instances/snapshots/tmpotsoj9qo/ee8b1b6f4b7047eca98c6a40147ef704" returned: 0 in 0.509s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Snapshot extracted, beginning image upload
Nov 11 00:12:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updated VIF entry in instance network info cache for port 72682323-e45b-4a04-9e61-06dbe1924488. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9aebbb8c-b87a-4420-9476-6fe888514bff req-f5a66fd1-9c63-48d0-bfc8-d8705fd7bbbf service nova] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'pci_requests' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.objects.base [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Object Instance<7b70effe-d5d7-4df7-946e-4da6b7c2816e> lazy-loaded attributes: flavor,pci_requests {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:12:16 user nova-compute[75279]: DEBUG nova.policy [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d2cf04159da4f1986f253dc994074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1b87e530aa40a2a74947ac0baccc2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-d98b4ae9-ad6f-4602-b870-3f14ff869753 req-2b1b6c63-d8f5-4cab-9821-4fc048b6d7ca service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-deleted-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:17 user nova-compute[75279]: INFO nova.compute.manager [req-d98b4ae9-ad6f-4602-b870-3f14ff869753 req-2b1b6c63-d8f5-4cab-9821-4fc048b6d7ca service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Neutron deleted interface b9e08345-100c-4075-a847-c73c1d8a3c85; detaching it from the instance and deleting it from the info cache
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-d98b4ae9-ad6f-4602-b870-3f14ff869753 req-2b1b6c63-d8f5-4cab-9821-4fc048b6d7ca service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:17 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Took 0.97 seconds to deallocate network for instance.
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-d98b4ae9-ad6f-4602-b870-3f14ff869753 req-2b1b6c63-d8f5-4cab-9821-4fc048b6d7ca service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Detach interface failed, port_id=b9e08345-100c-4075-a847-c73c1d8a3c85, reason: Instance cf144ba3-c7c9-4a61-91a5-4d463262af48 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] Acquiring lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] No waiting events found dispatching network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:17 user nova-compute[75279]: WARNING nova.compute.manager [req-c1f8fe80-fa63-49e1-8b2d-f3d59fe7278f req-551539a3-c81b-436a-aae4-770591bbf37c service nova] [instance: cf144ba3-c7c9-4a61-91a5-4d463262af48] Received unexpected event network-vif-plugged-b9e08345-100c-4075-a847-c73c1d8a3c85 for instance with vm_state deleted and task_state None.
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:17 user nova-compute[75279]: DEBUG nova.network.neutron [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Successfully created port: 9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:12:17 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Deleted allocations for instance cf144ba3-c7c9-4a61-91a5-4d463262af48
Nov 11 00:12:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f5e215cd-1bab-481d-953d-7bec32b4013b tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "cf144ba3-c7c9-4a61-91a5-4d463262af48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.808s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Successfully updated port: 9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG nova.network.neutron [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-changed-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing instance network info cache due to event network-changed-9b4b49ac-6d84-41c9-8e94-53a2b630a55c. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:12:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:19 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Snapshot image upload complete
Nov 11 00:12:19 user nova-compute[75279]: INFO nova.compute.manager [None req-805cebbd-9ab7-4008-8021-aec651b71bfe tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Took 6.15 seconds to snapshot the instance on the hypervisor.
Nov 11 00:12:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Refreshing network info cache for port 9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG os_vif [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe52aeae-56e0-5303-9d74-fc139929ab13', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b4b49ac-6d, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b4b49ac-6d, col_values=(('qos', UUID('a042c925-e2ef-4baf-af9f-511cf7ca2341')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b4b49ac-6d, col_values=(('external_ids', {'iface-id': '9b4b49ac-6d84-41c9-8e94-53a2b630a55c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:58:35', 'vm-uuid': '7b70effe-d5d7-4df7-946e-4da6b7c2816e'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: INFO os_vif [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d')
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] attach device xml: <interface type="ethernet">
Nov 11 00:12:19 user nova-compute[75279]:   <mac address="fa:16:3e:d3:58:35"/>
Nov 11 00:12:19 user nova-compute[75279]:   <model type="virtio"/>
Nov 11 00:12:19 user nova-compute[75279]:   <mtu size="1442"/>
Nov 11 00:12:19 user nova-compute[75279]:   <target dev="tap9b4b49ac-6d"/>
Nov 11 00:12:19 user nova-compute[75279]: </interface>
Nov 11 00:12:19 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name hda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No VIF found with MAC fa:16:3e:49:67:ac, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:12:20 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:12:20</nova:creationTime>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:12:20 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:12:20 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:owner>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:12:20 user nova-compute[75279]:   </nova:owner>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:12:20 user nova-compute[75279]:   <nova:ports>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:12:20 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:12:20 user nova-compute[75279]:     </nova:port>
Nov 11 00:12:20 user nova-compute[75279]:     <nova:port uuid="9b4b49ac-6d84-41c9-8e94-53a2b630a55c">
Nov 11 00:12:20 user nova-compute[75279]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 11 00:12:20 user nova-compute[75279]:     </nova:port>
Nov 11 00:12:20 user nova-compute[75279]:   </nova:ports>
Nov 11 00:12:20 user nova-compute[75279]: </nova:instance>
Nov 11 00:12:20 user nova-compute[75279]:  {{(pid=75279) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-15ff53fc-100a-4245-bf6b-47601e8d9d12 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.617s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.network.neutron [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updated VIF entry in instance network info cache for port 9b4b49ac-6d84-41c9-8e94-53a2b630a55c. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.network.neutron [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d264ba3-9535-4ad3-8e4e-55d7ac8bbdc0 req-97ade356-62e1-4237-ba3a-bd887202d922 service nova] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:20 user nova-compute[75279]: WARNING nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c for instance with vm_state active and task_state None.
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:20 user nova-compute[75279]: WARNING nova.compute.manager [req-9b60638b-5b53-4747-8542-cfbf6ca623d1 req-572f0f60-0d11-48f5-b230-22915c55f2b5 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c for instance with vm_state active and task_state None.
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:20 user nova-compute[75279]: INFO nova.compute.manager [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Attaching volume c251aa4d-eabc-4d74-93ef-dcf6eb028908 to /dev/vdb
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.utils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[34390207-9a18-4616-8acd-5179d7eace14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d5dc5e-180f-45fb-a72d-bcef56d98262]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca610f-d93a-4f60-a0e9-37e83dd9a39c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbf53a-ef63-44f7-915f-5d387507540f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:12:20 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:12:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[05288773-f405-4d0c-86fc-777d4a4ab7b9]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG os_brick.utils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:12:20 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating existing volume attachment record: 9b0a9a05-02bd-418a-9a72-f6ee0daaff10 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:21 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:12:21 user nova-compute[75279]: INFO nova.compute.claims [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Claim successful on node user
Nov 11 00:12:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:12:22 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.policy [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3793bc64e645f3b220d49f6c409904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be6b384229b48c4b9cf6c8f134967d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:12:22 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Creating image(s)
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "/opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "/opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "/opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk 1073741824" returned: 0 in 0.060s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Successfully created port: 90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Cannot resize image /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Ensure instance console log exists: /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Successfully updated port: 90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-changed-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.compute.manager [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Refreshing instance network info cache due to event network-changed-90f983f8-1933-45e1-8366-2c4fefa038d4. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] Acquiring lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] Acquired lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Refreshing network info cache for port 90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d95543bb-5a28-4215-b79f-b54acc34d2e5 req-7bb689ba-4510-47ca-a1c2-0e1d9a0ba021 service nova] Releasing lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquired lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:12:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.network.neutron [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updating instance_info_cache with network_info: [{"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Releasing lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance network_info: |[{"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Start _get_guest_xml network_info=[{"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:12:25 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:12:25 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1179496731',display_name='tempest-AttachVolumeTestJSON-server-1179496731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1179496731',id=24,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE9B3NyBDi2DbZXtBn6/IO4gj48XW9adN0UZ2wkyitSbFFq5v81HxwsDukITlBqUibrA2izAkrkEyoGV1pYN4B/lP1f1QbAZtOXgwgVpO1FbeAGHSccSpOOKIAjIqV8Mw==',key_name='tempest-keypair-276396208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-sun10hm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=600c2f85-9476-48eb-b37f-7e845469fc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.objects.instance [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'pci_devices' on Instance uuid 600c2f85-9476-48eb-b37f-7e845469fc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:12:25 user nova-compute[75279]:   <uuid>600c2f85-9476-48eb-b37f-7e845469fc5d</uuid>
Nov 11 00:12:25 user nova-compute[75279]:   <name>instance-00000018</name>
Nov 11 00:12:25 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:12:25 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:12:25 user nova-compute[75279]:   <metadata>
Nov 11 00:12:25 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:12:25 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeTestJSON-server-1179496731</nova:name>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:12:25</nova:creationTime>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:12:25 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:12:25 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:owner>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:user uuid="4d3793bc64e645f3b220d49f6c409904">tempest-AttachVolumeTestJSON-896218417-project-member</nova:user>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:project uuid="1be6b384229b48c4b9cf6c8f134967d1">tempest-AttachVolumeTestJSON-896218417</nova:project>
Nov 11 00:12:25 user nova-compute[75279]:       </nova:owner>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:12:25 user nova-compute[75279]:       <nova:ports>
Nov 11 00:12:25 user nova-compute[75279]:         <nova:port uuid="90f983f8-1933-45e1-8366-2c4fefa038d4">
Nov 11 00:12:25 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 11 00:12:25 user nova-compute[75279]:         </nova:port>
Nov 11 00:12:25 user nova-compute[75279]:       </nova:ports>
Nov 11 00:12:25 user nova-compute[75279]:     </nova:instance>
Nov 11 00:12:25 user nova-compute[75279]:   </metadata>
Nov 11 00:12:25 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:12:25 user nova-compute[75279]:     <system>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="serial">600c2f85-9476-48eb-b37f-7e845469fc5d</entry>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="uuid">600c2f85-9476-48eb-b37f-7e845469fc5d</entry>
Nov 11 00:12:25 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:12:25 user nova-compute[75279]:     </system>
Nov 11 00:12:25 user nova-compute[75279]:   </sysinfo>
Nov 11 00:12:25 user nova-compute[75279]:   <os>
Nov 11 00:12:25 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:12:25 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:12:25 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:12:25 user nova-compute[75279]:   </os>
Nov 11 00:12:25 user nova-compute[75279]:   <features>
Nov 11 00:12:25 user nova-compute[75279]:     <acpi/>
Nov 11 00:12:25 user nova-compute[75279]:     <apic/>
Nov 11 00:12:25 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:12:25 user nova-compute[75279]:   </features>
Nov 11 00:12:25 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:12:25 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:12:25 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:12:25 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:12:25 user nova-compute[75279]:   </clock>
Nov 11 00:12:25 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:12:25 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:12:25 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:12:25 user nova-compute[75279]:   </cpu>
Nov 11 00:12:25 user nova-compute[75279]:   <devices>
Nov 11 00:12:25 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:12:25 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:12:25 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk"/>
Nov 11 00:12:25 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:12:25 user nova-compute[75279]:     </disk>
Nov 11 00:12:25 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:12:25 user nova-compute[75279]:       <mac address="fa:16:3e:33:8a:6e"/>
Nov 11 00:12:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:12:25 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:12:25 user nova-compute[75279]:       <target dev="tap90f983f8-19"/>
Nov 11 00:12:25 user nova-compute[75279]:     </interface>
Nov 11 00:12:25 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:12:25 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/console.log" append="off"/>
Nov 11 00:12:25 user nova-compute[75279]:     </serial>
Nov 11 00:12:25 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:12:25 user nova-compute[75279]:     <video>
Nov 11 00:12:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:12:25 user nova-compute[75279]:     </video>
Nov 11 00:12:25 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:12:25 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:12:25 user nova-compute[75279]:     </rng>
Nov 11 00:12:25 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:12:25 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:12:25 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:12:25 user nova-compute[75279]:     </memballoon>
Nov 11 00:12:25 user nova-compute[75279]:   </devices>
Nov 11 00:12:25 user nova-compute[75279]: </domain>
Nov 11 00:12:25 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1179496731',display_name='tempest-AttachVolumeTestJSON-server-1179496731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1179496731',id=24,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE9B3NyBDi2DbZXtBn6/IO4gj48XW9adN0UZ2wkyitSbFFq5v81HxwsDukITlBqUibrA2izAkrkEyoGV1pYN4B/lP1f1QbAZtOXgwgVpO1FbeAGHSccSpOOKIAjIqV8Mw==',key_name='tempest-keypair-276396208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-sun10hm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=600c2f85-9476-48eb-b37f-7e845469fc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG os_vif [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2739d129-7ea6-5690-a7d5-39f2c4d6a4bf', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90f983f8-19, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90f983f8-19, col_values=(('qos', UUID('89a43ec3-6dab-407c-b0f0-14750810fe67')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90f983f8-19, col_values=(('external_ids', {'iface-id': '90f983f8-1933-45e1-8366-2c4fefa038d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:8a:6e', 'vm-uuid': '600c2f85-9476-48eb-b37f-7e845469fc5d'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:25 user nova-compute[75279]: INFO os_vif [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19')
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:12:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] No VIF found with MAC fa:16:3e:33:8a:6e, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] No waiting events found dispatching network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:26 user nova-compute[75279]: WARNING nova.compute.manager [req-2ce93c06-0472-4530-85ea-d4cef97c429c req-b8c524f0-03c4-43a5-95d4-fd76e0e46e0d service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received unexpected event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 for instance with vm_state building and task_state spawning.
Nov 11 00:12:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:12:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance spawned successfully.
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] No waiting events found dispatching network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:28 user nova-compute[75279]: WARNING nova.compute.manager [req-72753224-3380-4ba1-8217-8186f8f04521 req-e16acde2-9d4b-4fb2-833c-7a7026ed1c4e service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received unexpected event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 for instance with vm_state building and task_state spawning.
Nov 11 00:12:28 user nova-compute[75279]: INFO nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 11 00:12:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:12:29 user nova-compute[75279]: INFO nova.compute.manager [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Took 7.42 seconds to build instance.
Nov 11 00:12:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-87bd3fee-8519-476f-aae6-e3f9471ed606 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.528s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:12:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:12:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:12:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.22071075439453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 508cd740-432b-433c-803f-da3892a04d48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:12:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:12:39 user nova-compute[75279]: INFO nova.compute.claims [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Claim successful on node user
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:12:39 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:12:39 user nova-compute[75279]: DEBUG nova.policy [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5de431660e34578b7ef8b6b7e0577ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56bb9030efe414aa52c4aa97febfd2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:12:39 user nova-compute[75279]: INFO nova.virt.block_device [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Booting with volume cd475a1e-79de-4ff4-8efb-0b5c900998c8 at /dev/vda
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[322b4141-31dd-4eb3-b0ca-accf25234ef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce913d8-6237-4cc2-8cae-93071ace19aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573e050-3e55-4aa9-ba76-fed39a2d0289]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d4e6ca-252c-4bef-a34a-22e60ecb1634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:12:40 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:12:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af8df8-a1dd-438f-b2b1-2873751653f5]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating existing volume attachment record: f5e85a7b-eb48-4da2-a826-b3ed3976d1e2 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:12:40 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Successfully created port: 71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Successfully updated port: 71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-changed-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Refreshing instance network info cache due to event network-changed-71c32096-1127-4b3b-b506-b52ae75f2951. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance network_info: |[{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Refreshing network info cache for port 71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updated VIF entry in instance network info cache for port 71c32096-1127-4b3b-b506-b52ae75f2951. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb6190e2-321e-4dd9-b0c3-59b56252ee78 req-ff70074e-5548-4c1c-80b4-4ec7a6ef7186 service nova] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:12:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjGRLOpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:12:48 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:12:48 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:12:48 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fa40bf-c1ac-4d95-94e4-94b0878335ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:12:48 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[436837e6-c216-4bdc-a71f-4f3f5b8999c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908] added
Nov 11 00:12:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cb8fca-380d-4a4a-8101-fe88a1f6e009]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510ca26-cd77-42e0-b5cc-94c6deffe868]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjGRLOpZ {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjGRLOpZ" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4cb06a-7ca0-4eb1-a6f7-ef7a585dc804]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SjGRLOpZ'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[01791a03-8f51-4cb3-b341-c7bbaa911675]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a6c49-4546-4e7d-853c-43ddd6ffcac0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:12:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:12:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b2ff7-bfff-48db-b949-634290d3b34d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260]
Nov 11 00:12:49 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260] successful.
Nov 11 00:12:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7604228e-7670-4d02-a3d6-720f7f72c8da]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699ee5b-b749-41d2-a520-339ae180fe48]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:12:49 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:12:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c24d4e-1843-4a38-9cdd-f9a41470de00]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:12:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjGRLOpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23434643665643533', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434643665643533', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:12:50 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:12:50 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:12:50 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:12:50 user nova-compute[75279]:   <serial>c251aa4d-eabc-4d74-93ef-dcf6eb028908</serial>
Nov 11 00:12:50 user nova-compute[75279]: </disk>
Nov 11 00:12:50 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No BDM found with device name hda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] No VIF found with MAC fa:16:3e:49:67:ac, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:12:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c2cebcca-01c2-4dab-be4c-ad9dabe58b44 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.246s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:52 user nova-compute[75279]: INFO nova.compute.manager [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Detaching volume c251aa4d-eabc-4d74-93ef-dcf6eb028908
Nov 11 00:12:52 user nova-compute[75279]: INFO nova.virt.block_device [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Attempting to driver detach volume c251aa4d-eabc-4d74-93ef-dcf6eb028908 from mountpoint /dev/vdb
Nov 11 00:12:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Attempting to detach device vdb from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:12:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:12:52 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:12:52 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:12:52 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:12:52 user nova-compute[75279]:   <serial>c251aa4d-eabc-4d74-93ef-dcf6eb028908</serial>
Nov 11 00:12:52 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 00:12:52 user nova-compute[75279]: </disk>
Nov 11 00:12:52 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:12:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully detached device vdb from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the persistent domain config.
Nov 11 00:12:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:12:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:12:52 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:12:52 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:12:52 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:12:52 user nova-compute[75279]:   <serial>c251aa4d-eabc-4d74-93ef-dcf6eb028908</serial>
Nov 11 00:12:52 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 00:12:52 user nova-compute[75279]: </disk>
Nov 11 00:12:52 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:12:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:12:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:59 user nova-compute[75279]: INFO nova.compute.manager [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Unrescuing
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG nova.objects.instance [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'flavor' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:12:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:12:59 user nova-compute[75279]: WARNING nova.compute.manager [req-ac94e9b9-e032-40c2-b84a-48cd9435df43 req-5de8702e-1c25-4d8a-8611-7339ef7aa9dc service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance destroyed successfully.
Nov 11 00:13:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:02 user nova-compute[75279]: WARNING nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:02 user nova-compute[75279]: WARNING nova.compute.manager [req-77adfbde-aaae-4659-b8c9-6de6d2a3e290 req-e36d7308-116d-43b5-9860-6a328a76d394 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-00bd5166-8f2d-4fef-bbe4-c00587d4b1ef tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:04 user nova-compute[75279]: WARNING nova.compute.manager [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state None.
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-changed-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Refreshing instance network info cache due to event network-changed-e4899405-99b5-4dea-a45f-6a7a37a89588. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Acquiring lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Acquired lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.network.neutron [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Refreshing network info cache for port e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Ignoring supplied device name: /dev/vdb
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:04 user nova-compute[75279]: INFO nova.compute.manager [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Attaching volume 58293abc-c375-4c99-b4a2-61d4976913db to /dev/vdb
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c67980-fedc-4da5-943d-6aa6317a39c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e4694-fc32-41d9-8520-586ca39a9029]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a18bd-29a9-4514-85f7-d5e6cee53bf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a56bd47-04ae-4d74-8c47-de8cf69e00a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.network.neutron [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updated VIF entry in instance network info cache for port e4899405-99b5-4dea-a45f-6a7a37a89588. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.network.neutron [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updating instance_info_cache with network_info: [{"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ff814559-feb1-47b3-91fd-dc0f99b6deb6 req-e293ab0d-d09d-44d9-a202-94ed3194a54e service nova] Releasing lock "refresh_cache-07457a5e-5ed9-4d25-8218-aabe1c4689ae" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:13:04 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:13:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3261f-3192-45cb-b2f6-2b542059ffa6]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:13:04 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updating existing volume attachment record: 952041ea-8d2f-4f48-86ea-7795ccd97779 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:13:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:07 user nova-compute[75279]: INFO nova.compute.manager [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Unrescuing
Nov 11 00:13:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'flavor' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:13:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Creating image(s)
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Ensure instance console log exists: /opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start _get_guest_xml network_info=[{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6e1b6b4-8688-4d28-b8e0-6828053720f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'serial': 'cd475a1e-79de-4ff4-8efb-0b5c900998c8'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'f5e85a7b-eb48-4da2-a826-b3ed3976d1e2', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:13:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:13:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:08 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bf0e07-ddf5-40a9-82fa-964991fbe4b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:13:08 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17f3cc1-0009-49b2-be8c-8a3fcdb29f7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8] added
Nov 11 00:13:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b960457-0192-44e8-8841-3ce354e25e30]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5182ca67-9326-470e-b7ff-4d97b0aa7055]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxqZhPDC {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxqZhPDC" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[53547a45-0d20-451a-9cc9-81f962440563]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mxqZhPDC'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b0f57-0d6d-404b-bd14-e749046220f1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9787a29-5e0d-4d98-a77d-75232dc3f893]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d43338d-0006-4846-96d3-5a29200ad7e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]
Nov 11 00:13:09 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.
Nov 11 00:13:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance destroyed successfully.
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:09 user nova-compute[75279]: WARNING nova.compute.manager [req-42526439-58f4-48f5-9076-91fd61348f17 req-feaebaf3-3121-4ece-96fe-d26b5b0f52d8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36f30c9-8de6-4b92-b17f-ed502808a089]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c499a2-4d4d-454b-90ec-6d8cf8732ced]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:09 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc76a26-d740-464a-a8eb-299f79a93b93]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:09 user nova-compute[75279]: INFO nova.compute.manager [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Terminating instance
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dd36a132-34af-48e4-bd11-86cb2ed9f9f1 req-3abbd1e5-ede5-4fc8-bca0-f02d2e7883f4 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-unplugged-f948b442-834c-45b5-a217-e97f753b968d for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23662316662636265', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662316662636265', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'pci_devices' on Instance uuid c6e1b6b4-8688-4d28-b8e0-6828053720f1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:13:10 user nova-compute[75279]:   <uuid>c6e1b6b4-8688-4d28-b8e0-6828053720f1</uuid>
Nov 11 00:13:10 user nova-compute[75279]:   <name>instance-00000019</name>
Nov 11 00:13:10 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:13:10 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:13:10 user nova-compute[75279]:   <metadata>
Nov 11 00:13:10 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:10 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:13:10 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherA-server-1762044897</nova:name>
Nov 11 00:13:10 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:13:08</nova:creationTime>
Nov 11 00:13:10 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:13:10 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:10 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:13:10 user nova-compute[75279]:       <nova:owner>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:user uuid="f5de431660e34578b7ef8b6b7e0577ab">tempest-ServerActionsTestOtherA-191498200-project-member</nova:user>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:project uuid="e56bb9030efe414aa52c4aa97febfd2e">tempest-ServerActionsTestOtherA-191498200</nova:project>
Nov 11 00:13:10 user nova-compute[75279]:       </nova:owner>
Nov 11 00:13:10 user nova-compute[75279]:       <nova:ports>
Nov 11 00:13:10 user nova-compute[75279]:         <nova:port uuid="71c32096-1127-4b3b-b506-b52ae75f2951">
Nov 11 00:13:10 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:13:10 user nova-compute[75279]:         </nova:port>
Nov 11 00:13:10 user nova-compute[75279]:       </nova:ports>
Nov 11 00:13:10 user nova-compute[75279]:     </nova:instance>
Nov 11 00:13:10 user nova-compute[75279]:   </metadata>
Nov 11 00:13:10 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:13:10 user nova-compute[75279]:     <system>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="serial">c6e1b6b4-8688-4d28-b8e0-6828053720f1</entry>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="uuid">c6e1b6b4-8688-4d28-b8e0-6828053720f1</entry>
Nov 11 00:13:10 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:13:10 user nova-compute[75279]:     </system>
Nov 11 00:13:10 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:10 user nova-compute[75279]:   <os>
Nov 11 00:13:10 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:13:10 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:13:10 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:13:10 user nova-compute[75279]:   </os>
Nov 11 00:13:10 user nova-compute[75279]:   <features>
Nov 11 00:13:10 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:10 user nova-compute[75279]:     <apic/>
Nov 11 00:13:10 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:13:10 user nova-compute[75279]:   </features>
Nov 11 00:13:10 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:13:10 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:13:10 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:13:10 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:13:10 user nova-compute[75279]:   </clock>
Nov 11 00:13:10 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:13:10 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:13:10 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:13:10 user nova-compute[75279]:   </cpu>
Nov 11 00:13:10 user nova-compute[75279]:   <devices>
Nov 11 00:13:10 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:13:10 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:13:10 user nova-compute[75279]:       <source dev="/dev/sdf"/>
Nov 11 00:13:10 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:13:10 user nova-compute[75279]:       <serial>cd475a1e-79de-4ff4-8efb-0b5c900998c8</serial>
Nov 11 00:13:10 user nova-compute[75279]:     </disk>
Nov 11 00:13:10 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:13:10 user nova-compute[75279]:       <mac address="fa:16:3e:72:db:2e"/>
Nov 11 00:13:10 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:13:10 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:13:10 user nova-compute[75279]:       <target dev="tap71c32096-11"/>
Nov 11 00:13:10 user nova-compute[75279]:     </interface>
Nov 11 00:13:10 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:13:10 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1/console.log" append="off"/>
Nov 11 00:13:10 user nova-compute[75279]:     </serial>
Nov 11 00:13:10 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:13:10 user nova-compute[75279]:     <video>
Nov 11 00:13:10 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:13:10 user nova-compute[75279]:     </video>
Nov 11 00:13:10 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:13:10 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:13:10 user nova-compute[75279]:     </rng>
Nov 11 00:13:10 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:13:10 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:13:10 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:13:10 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:10 user nova-compute[75279]:   </devices>
Nov 11 00:13:10 user nova-compute[75279]: </domain>
Nov 11 00:13:10 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG os_vif [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0019765-39ae-5cb4-b44f-45d66a8155cf', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71c32096-11, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71c32096-11, col_values=(('qos', UUID('c1d452b1-004f-4e0f-bcd0-3be225ba9331')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71c32096-11, col_values=(('external_ids', {'iface-id': '71c32096-1127-4b3b-b506-b52ae75f2951', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:db:2e', 'vm-uuid': 'c6e1b6b4-8688-4d28-b8e0-6828053720f1'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: INFO os_vif [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11')
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:72:db:2e, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:13:10 user nova-compute[75279]: INFO nova.compute.claims [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Claim successful on node user
Nov 11 00:13:10 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Instance destroyed successfully.
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lazy-loading 'resources' on Instance uuid 508cd740-432b-433c-803f-da3892a04d48 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1302584730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1721693801',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7ukhnt64yVRYwcA8WMG8/RhNQwlK+OMEpZa08ZOmAoeKV6YdbCHD0q4cyeYzUWeJ7DVhn92IwPkIX7N6TIT6Nm68R8dsvctpv18dLLXxRSz9Gsv5lVugUMq0cPqG/h0A==',key_name='tempest-keypair-1072457080',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='280c69c91fb040f79bd21c7bd89672ac',ramdisk_id='',reservation_id='r-d4wmnnsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1040260601',owner_user_name='tempest-ServerActionsV293TestJSON-1040260601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fe0334c76ab4a77819bb11e42e3ba3a',uuid=508cd740-432b-433c-803f-da3892a04d48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converting VIF {"id": "f948b442-834c-45b5-a217-e97f753b968d", "address": "fa:16:3e:f7:47:51", "network": {"id": "f1e8b782-7355-4605-9c65-65ffd4f97749", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-686084820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280c69c91fb040f79bd21c7bd89672ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf948b442-83", "ovs_interfaceid": "f948b442-834c-45b5-a217-e97f753b968d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG os_vif [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf948b442-83, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4c12ee9-2568-49de-a108-7edfcc692809) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:11 user nova-compute[75279]: INFO os_vif [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:47:51,bridge_name='br-int',has_traffic_filtering=True,id=f948b442-834c-45b5-a217-e97f753b968d,network=Network(f1e8b782-7355-4605-9c65-65ffd4f97749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf948b442-83')
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVAcJKBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:13:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca053476-5d98-42c9-80c1-deee1e9bca12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:13:11 user nova-compute[75279]: No targets found.
Nov 11 00:13:11 user nova-compute[75279]: iSNS:
Nov 11 00:13:11 user nova-compute[75279]: No targets found.
Nov 11 00:13:11 user nova-compute[75279]: STATIC:
Nov 11 00:13:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:13:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:13:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908
Nov 11 00:13:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:13:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e
Nov 11 00:13:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:11 user nova-compute[75279]: FIRMWARE:
Nov 11 00:13:11 user nova-compute[75279]: No targets found.
Nov 11 00:13:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:13:11 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:13:11 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea62ff-2d6c-45e3-b3ce-d5db9ba8c1be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cb1d9-e6e7-400e-8957-dfab87f81f4f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e061fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5e6a25-0462-4e1f-b2de-a2d7ff42fcbc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a49d5-3c0f-49d6-9c60-c9b85f5846ad]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b28359-0ca1-424d-83d8-f930040e5b99]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:11 user nova-compute[75279]: WARNING nova.compute.manager [req-ec99a1ed-12c0-48b3-858a-90c70d4b1261 req-b48d3549-7f1e-4823-af86-7ef9a914232e service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[945cfa57-1801-4625-baa4-e8f5e8e91517]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:13:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a54613-82a5-4103-a883-f6f80dae9509]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.policy [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1203d275ebd34ce1a5840ca4b34f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683d6ebfe4794b67b6ec49ce83a46745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1e84d-28b5-43fb-ac1d-9d1821a1cc4e]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260]
Nov 11 00:13:11 user nova-compute[75279]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e, portal: 172.16.0.220,3260] successful.
Nov 11 00:13:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29d22d-de46-4695-b605-bc41dd0c8474]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] <== disconnect_volume: return (407ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:13:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deleting instance files /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48_del
Nov 11 00:13:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deletion of /opt/stack/data/nova/instances/508cd740-432b-433c-803f-da3892a04d48_del complete
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:13:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Creating image(s)
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "/opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: INFO nova.compute.manager [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Took 2.04 seconds to destroy the instance on the hypervisor.
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.213s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk 1073741824" returned: 0 in 0.060s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] Acquiring lock "508cd740-432b-433c-803f-da3892a04d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] Lock "508cd740-432b-433c-803f-da3892a04d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] No waiting events found dispatching network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:12 user nova-compute[75279]: WARNING nova.compute.manager [req-f582ddd9-9b49-4f46-985a-e60a33fdcb12 req-e2a5ef9c-c19c-4c96-948c-1a49e1724da5 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received unexpected event network-vif-plugged-f948b442-834c-45b5-a217-e97f753b968d for instance with vm_state active and task_state deleting.
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Successfully created port: 58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Cannot resize image /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Ensure instance console log exists: /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:12 user nova-compute[75279]: WARNING nova.compute.manager [req-e802ae41-05b8-467e-8577-b541b76ab992 req-e7691156-af69-4849-92cd-13d9bba75bf8 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state building and task_state spawning.
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:13 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 508cd740-432b-433c-803f-da3892a04d48] Took 1.60 seconds to deallocate network for instance.
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:13 user nova-compute[75279]: WARNING nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:13 user nova-compute[75279]: WARNING nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-911d0bc6-bebb-438b-8471-65117d15c0e1 req-2bd02e14-d314-45af-a337-e7be21331821 service nova] [instance: 508cd740-432b-433c-803f-da3892a04d48] Received event network-vif-deleted-f948b442-834c-45b5-a217-e97f753b968d {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:13 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e is timed out.
Nov 11 00:13:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully detached device vdb from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the live domain config.
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjGRLOpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:13:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a2689c-b17d-446a-8418-e602760fc675]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:13:13 user nova-compute[75279]: No targets found.
Nov 11 00:13:13 user nova-compute[75279]: iSNS:
Nov 11 00:13:13 user nova-compute[75279]: No targets found.
Nov 11 00:13:13 user nova-compute[75279]: STATIC:
Nov 11 00:13:13 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:13:13 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:13 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:13 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:13:13 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:13 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:13 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908
Nov 11 00:13:13 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:13 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:13 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:13:13 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:13:13 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:13:13 user nova-compute[75279]: FIRMWARE:
Nov 11 00:13:13 user nova-compute[75279]: No targets found.
Nov 11 00:13:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:13:13 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:13:13 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[030739fb-2f8c-4171-a3d5-03935e8d2f01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3357ec-fabd-4ac5-b9d7-f66a0859750b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0725ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca2d83-9f51-446b-abaf-1adf52875e3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286318a-c365-4c7c-b9a3-7f0ae68bfeec]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9f1e1-cd14-475f-86fd-1c13e03eacd0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5e483-2bc7-4abc-9373-8c5a02c7ee40]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84c455-0a2b-4b32-b5b6-9ae6a3e08b7a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c94d4d-8f55-425f-b9cb-3f14acd5dcd7]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260]
Nov 11 00:13:13 user nova-compute[75279]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908, portal: 172.16.0.220,3260] successful.
Nov 11 00:13:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c251aa4d-eabc-4d74-93ef-dcf6eb028908 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fa35f-2d58-4bda-a1db-c6e4848a27f5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] <== disconnect_volume: return (401ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:13:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Successfully updated port: 58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquired lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:13:14 user nova-compute[75279]: INFO nova.compute.manager [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Took 1.09 seconds to detach 1 volumes for instance.
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] [instance: 508cd740-432b-433c-803f-da3892a04d48] Deleting volume: b8bdc8d5-e3d6-4cd9-9c32-fa3e5370224e {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating instance_info_cache with network_info: [{"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Releasing lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Instance network_info: |[{"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Start _get_guest_xml network_info=[{"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:13:14 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:14 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-568592888',display_name='tempest-AttachVolumeNegativeTest-server-568592888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-568592888',id=26,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH/AemGVduMVPSIB51/MYAt9EQDrgooh4jhF2ET1RfCmL+Sb0NX6hNWLTgf+0K05rFUy9VifCWZUpTPOVeM31Gk8Ps2ekEP3hY2CbbSNEj8qV+ZPWPY2K4qxtmh2sb29w==',key_name='tempest-keypair-1395581038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-dxy51lvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=e685210c-addc-45e1-a665-ab603c5f3340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'pci_devices' on Instance uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:13:14 user nova-compute[75279]:   <uuid>e685210c-addc-45e1-a665-ab603c5f3340</uuid>
Nov 11 00:13:14 user nova-compute[75279]:   <name>instance-0000001a</name>
Nov 11 00:13:14 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:13:14 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:13:14 user nova-compute[75279]:   <metadata>
Nov 11 00:13:14 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:14 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeNegativeTest-server-568592888</nova:name>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:13:14</nova:creationTime>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:13:14 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:14 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:owner>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:user uuid="1203d275ebd34ce1a5840ca4b34f2754">tempest-AttachVolumeNegativeTest-1189596006-project-member</nova:user>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:project uuid="683d6ebfe4794b67b6ec49ce83a46745">tempest-AttachVolumeNegativeTest-1189596006</nova:project>
Nov 11 00:13:14 user nova-compute[75279]:       </nova:owner>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:14 user nova-compute[75279]:       <nova:ports>
Nov 11 00:13:14 user nova-compute[75279]:         <nova:port uuid="58a1a8e8-041e-4e12-8540-0fcfa0837a4f">
Nov 11 00:13:14 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 11 00:13:14 user nova-compute[75279]:         </nova:port>
Nov 11 00:13:14 user nova-compute[75279]:       </nova:ports>
Nov 11 00:13:14 user nova-compute[75279]:     </nova:instance>
Nov 11 00:13:14 user nova-compute[75279]:   </metadata>
Nov 11 00:13:14 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:13:14 user nova-compute[75279]:     <system>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="serial">e685210c-addc-45e1-a665-ab603c5f3340</entry>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="uuid">e685210c-addc-45e1-a665-ab603c5f3340</entry>
Nov 11 00:13:14 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:13:14 user nova-compute[75279]:     </system>
Nov 11 00:13:14 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:14 user nova-compute[75279]:   <os>
Nov 11 00:13:14 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:13:14 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:13:14 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:13:14 user nova-compute[75279]:   </os>
Nov 11 00:13:14 user nova-compute[75279]:   <features>
Nov 11 00:13:14 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:14 user nova-compute[75279]:     <apic/>
Nov 11 00:13:14 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:13:14 user nova-compute[75279]:   </features>
Nov 11 00:13:14 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:13:14 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:13:14 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:13:14 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:13:14 user nova-compute[75279]:   </clock>
Nov 11 00:13:14 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:13:14 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:13:14 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:13:14 user nova-compute[75279]:   </cpu>
Nov 11 00:13:14 user nova-compute[75279]:   <devices>
Nov 11 00:13:14 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:13:14 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:13:14 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk"/>
Nov 11 00:13:14 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:13:14 user nova-compute[75279]:     </disk>
Nov 11 00:13:14 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:13:14 user nova-compute[75279]:       <mac address="fa:16:3e:14:e6:7c"/>
Nov 11 00:13:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:13:14 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:13:14 user nova-compute[75279]:       <target dev="tap58a1a8e8-04"/>
Nov 11 00:13:14 user nova-compute[75279]:     </interface>
Nov 11 00:13:14 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:13:14 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/console.log" append="off"/>
Nov 11 00:13:14 user nova-compute[75279]:     </serial>
Nov 11 00:13:14 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:13:14 user nova-compute[75279]:     <video>
Nov 11 00:13:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:13:14 user nova-compute[75279]:     </video>
Nov 11 00:13:14 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:13:14 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:13:14 user nova-compute[75279]:     </rng>
Nov 11 00:13:14 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:13:14 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:13:14 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:13:14 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:14 user nova-compute[75279]:   </devices>
Nov 11 00:13:14 user nova-compute[75279]: </domain>
Nov 11 00:13:14 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-568592888',display_name='tempest-AttachVolumeNegativeTest-server-568592888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-568592888',id=26,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH/AemGVduMVPSIB51/MYAt9EQDrgooh4jhF2ET1RfCmL+Sb0NX6hNWLTgf+0K05rFUy9VifCWZUpTPOVeM31Gk8Ps2ekEP3hY2CbbSNEj8qV+ZPWPY2K4qxtmh2sb29w==',key_name='tempest-keypair-1395581038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-dxy51lvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=e685210c-addc-45e1-a665-ab603c5f3340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG os_vif [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd51154eb-f06a-5eac-b4a9-b9ead48de0b5', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58a1a8e8-04, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58a1a8e8-04, col_values=(('qos', UUID('44db1365-fa1e-43c6-a45d-b100250e78ce')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58a1a8e8-04, col_values=(('external_ids', {'iface-id': '58a1a8e8-041e-4e12-8540-0fcfa0837a4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:e6:7c', 'vm-uuid': 'e685210c-addc-45e1-a665-ab603c5f3340'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:14 user nova-compute[75279]: INFO os_vif [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04')
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:14 user nova-compute[75279]: WARNING nova.compute.manager [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state building and task_state spawning.
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-changed-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Refreshing instance network info cache due to event network-changed-58a1a8e8-041e-4e12-8540-0fcfa0837a4f. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Acquiring lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Acquired lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Refreshing network info cache for port 58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:13:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:14:e6:7c, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.network.neutron [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updated VIF entry in instance network info cache for port 58a1a8e8-041e-4e12-8540-0fcfa0837a4f. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.network.neutron [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating instance_info_cache with network_info: [{"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dda651f9-f482-4000-bf6a-3548adbb7e5b req-a9b13825-f82e-46d6-bea1-2321473b4086 service nova] Releasing lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2efdc5d1-e7f0-495f-8e2e-418b78bae380 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.639s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:15 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Deleted allocations for instance 508cd740-432b-433c-803f-da3892a04d48
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:13:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance spawned successfully.
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9f19c6a7-b13a-4258-8d66-c48b5b5fbb13 tempest-ServerActionsV293TestJSON-1040260601 tempest-ServerActionsV293TestJSON-1040260601-project-member] Lock "508cd740-432b-433c-803f-da3892a04d48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.061s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4a67f4eb-4e8e-49de-b995-ddc4e2e72a66 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:13:15 user nova-compute[75279]: INFO nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:13:15 user nova-compute[75279]: INFO nova.compute.manager [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Took 36.71 seconds to build instance.
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fef63268-9bf6-4f00-962d-116c4bd3d035 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.841s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-9b4b49ac-6d84-41c9-8e94-53a2b630a55c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-9b4b49ac-6d84-41c9-8e94-53a2b630a55c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Attempting to detach device tap9b4b49ac-6d from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] detach device xml: <interface type="ethernet">
Nov 11 00:13:15 user nova-compute[75279]:   <mac address="fa:16:3e:d3:58:35"/>
Nov 11 00:13:15 user nova-compute[75279]:   <model type="virtio"/>
Nov 11 00:13:15 user nova-compute[75279]:   <mtu size="1442"/>
Nov 11 00:13:15 user nova-compute[75279]:   <target dev="tap9b4b49ac-6d"/>
Nov 11 00:13:15 user nova-compute[75279]: </interface>
Nov 11 00:13:15 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface>not found in domain: <domain type='kvm' id='28'>
Nov 11 00:13:15 user nova-compute[75279]:   <name>instance-00000016</name>
Nov 11 00:13:15 user nova-compute[75279]:   <uuid>7b70effe-d5d7-4df7-946e-4da6b7c2816e</uuid>
Nov 11 00:13:15 user nova-compute[75279]:   <metadata>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:15 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:12:20</nova:creationTime>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:15 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:15 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:15 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:15 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:15 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:15 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:15 user nova-compute[75279]:     <nova:port uuid="9b4b49ac-6d84-41c9-8e94-53a2b630a55c">
Nov 11 00:13:15 user nova-compute[75279]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 11 00:13:15 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:15 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:15 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:15 user nova-compute[75279]:   </metadata>
Nov 11 00:13:15 user nova-compute[75279]:   <memory unit='KiB'>524288</memory>
Nov 11 00:13:15 user nova-compute[75279]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 00:13:15 user nova-compute[75279]:   <vcpu placement='static'>1</vcpu>
Nov 11 00:13:15 user nova-compute[75279]:   <resource>
Nov 11 00:13:15 user nova-compute[75279]:     <partition>/machine</partition>
Nov 11 00:13:15 user nova-compute[75279]:   </resource>
Nov 11 00:13:15 user nova-compute[75279]:   <sysinfo type='smbios'>
Nov 11 00:13:15 user nova-compute[75279]:     <system>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='version'>0.0.0</entry>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='serial'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='uuid'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:15 user nova-compute[75279]:       <entry name='family'>Virtual Machine</entry>
Nov 11 00:13:15 user nova-compute[75279]:     </system>
Nov 11 00:13:15 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:15 user nova-compute[75279]:   <os>
Nov 11 00:13:15 user nova-compute[75279]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 00:13:15 user nova-compute[75279]:     <boot dev='hd'/>
Nov 11 00:13:15 user nova-compute[75279]:     <smbios mode='sysinfo'/>
Nov 11 00:13:15 user nova-compute[75279]:   </os>
Nov 11 00:13:15 user nova-compute[75279]:   <features>
Nov 11 00:13:15 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:15 user nova-compute[75279]:     <apic/>
Nov 11 00:13:15 user nova-compute[75279]:     <vmcoreinfo state='on'/>
Nov 11 00:13:15 user nova-compute[75279]:   </features>
Nov 11 00:13:15 user nova-compute[75279]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 00:13:15 user nova-compute[75279]:     <model fallback='forbid'>Nehalem</model>
Nov 11 00:13:15 user nova-compute[75279]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 00:13:15 user nova-compute[75279]:     <feature policy='require' name='vme'/>
Nov 11 00:13:15 user nova-compute[75279]:     <feature policy='require' name='x2apic'/>
Nov 11 00:13:15 user nova-compute[75279]:     <feature policy='require' name='hypervisor'/>
Nov 11 00:13:15 user nova-compute[75279]:   </cpu>
Nov 11 00:13:15 user nova-compute[75279]:   <clock offset='utc'>
Nov 11 00:13:15 user nova-compute[75279]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 00:13:15 user nova-compute[75279]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 00:13:15 user nova-compute[75279]:     <timer name='hpet' present='no'/>
Nov 11 00:13:15 user nova-compute[75279]:   </clock>
Nov 11 00:13:15 user nova-compute[75279]:   <on_poweroff>destroy</on_poweroff>
Nov 11 00:13:15 user nova-compute[75279]:   <on_reboot>restart</on_reboot>
Nov 11 00:13:15 user nova-compute[75279]:   <on_crash>destroy</on_crash>
Nov 11 00:13:15 user nova-compute[75279]:   <devices>
Nov 11 00:13:15 user nova-compute[75279]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 00:13:15 user nova-compute[75279]:     <disk type='file' device='disk'>
Nov 11 00:13:15 user nova-compute[75279]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 00:13:15 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk' index='2'/>
Nov 11 00:13:15 user nova-compute[75279]:       <backingStore type='file' index='3'>
Nov 11 00:13:15 user nova-compute[75279]:         <format type='raw'/>
Nov 11 00:13:15 user nova-compute[75279]:         <source file='/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a'/>
Nov 11 00:13:15 user nova-compute[75279]:         <backingStore/>
Nov 11 00:13:15 user nova-compute[75279]:       </backingStore>
Nov 11 00:13:15 user nova-compute[75279]:       <target dev='vda' bus='virtio'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='virtio-disk0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </disk>
Nov 11 00:13:15 user nova-compute[75279]:     <disk type='file' device='cdrom'>
Nov 11 00:13:15 user nova-compute[75279]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 00:13:15 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config' index='1'/>
Nov 11 00:13:15 user nova-compute[75279]:       <backingStore/>
Nov 11 00:13:15 user nova-compute[75279]:       <target dev='hda' bus='ide'/>
Nov 11 00:13:15 user nova-compute[75279]:       <readonly/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='ide0-0-0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </disk>
Nov 11 00:13:15 user nova-compute[75279]:     <controller type='usb' index='0' model='none'>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='usb'/>
Nov 11 00:13:15 user nova-compute[75279]:     </controller>
Nov 11 00:13:15 user nova-compute[75279]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='pci.0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </controller>
Nov 11 00:13:15 user nova-compute[75279]:     <controller type='ide' index='0'>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='ide'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 00:13:15 user nova-compute[75279]:     </controller>
Nov 11 00:13:15 user nova-compute[75279]:     <interface type='ethernet'>
Nov 11 00:13:15 user nova-compute[75279]:       <mac address='fa:16:3e:49:67:ac'/>
Nov 11 00:13:15 user nova-compute[75279]:       <target dev='tap72682323-e4'/>
Nov 11 00:13:15 user nova-compute[75279]:       <model type='virtio'/>
Nov 11 00:13:15 user nova-compute[75279]:       <mtu size='1442'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='net0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </interface>
Nov 11 00:13:15 user nova-compute[75279]:     <interface type='ethernet'>
Nov 11 00:13:15 user nova-compute[75279]:       <mac address='fa:16:3e:d3:58:35'/>
Nov 11 00:13:15 user nova-compute[75279]:       <target dev='tap9b4b49ac-6d'/>
Nov 11 00:13:15 user nova-compute[75279]:       <model type='virtio'/>
Nov 11 00:13:15 user nova-compute[75279]:       <mtu size='1442'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='net1'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </interface>
Nov 11 00:13:15 user nova-compute[75279]:     <serial type='pty'>
Nov 11 00:13:15 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:15 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:15 user nova-compute[75279]:       <target type='isa-serial' port='0'>
Nov 11 00:13:15 user nova-compute[75279]:         <model name='isa-serial'/>
Nov 11 00:13:15 user nova-compute[75279]:       </target>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </serial>
Nov 11 00:13:15 user nova-compute[75279]:     <console type='pty' tty='/dev/pts/3'>
Nov 11 00:13:15 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:15 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:15 user nova-compute[75279]:       <target type='serial' port='0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </console>
Nov 11 00:13:15 user nova-compute[75279]:     <input type='mouse' bus='ps2'>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='input0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </input>
Nov 11 00:13:15 user nova-compute[75279]:     <input type='keyboard' bus='ps2'>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='input1'/>
Nov 11 00:13:15 user nova-compute[75279]:     </input>
Nov 11 00:13:15 user nova-compute[75279]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 11 00:13:15 user nova-compute[75279]:       <listen type='address' address='0.0.0.0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </graphics>
Nov 11 00:13:15 user nova-compute[75279]:     <audio id='1' type='none'/>
Nov 11 00:13:15 user nova-compute[75279]:     <video>
Nov 11 00:13:15 user nova-compute[75279]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='video0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </video>
Nov 11 00:13:15 user nova-compute[75279]:     <memballoon model='virtio'>
Nov 11 00:13:15 user nova-compute[75279]:       <stats period='10'/>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='balloon0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:15 user nova-compute[75279]:     <rng model='virtio'>
Nov 11 00:13:15 user nova-compute[75279]:       <backend model='random'>/dev/urandom</backend>
Nov 11 00:13:15 user nova-compute[75279]:       <alias name='rng0'/>
Nov 11 00:13:15 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 00:13:15 user nova-compute[75279]:     </rng>
Nov 11 00:13:15 user nova-compute[75279]:   </devices>
Nov 11 00:13:15 user nova-compute[75279]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 00:13:15 user nova-compute[75279]:     <label>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</label>
Nov 11 00:13:15 user nova-compute[75279]:     <imagelabel>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</imagelabel>
Nov 11 00:13:15 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:15 user nova-compute[75279]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 00:13:15 user nova-compute[75279]:     <label>+64055:+108</label>
Nov 11 00:13:15 user nova-compute[75279]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 00:13:15 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:15 user nova-compute[75279]: </domain>
Nov 11 00:13:15 user nova-compute[75279]:  {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 00:13:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully detached device tap9b4b49ac-6d from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the persistent domain config.
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] (1/8): Attempting to detach device tap9b4b49ac-6d with device alias net1 from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:13:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] detach device xml: <interface type="ethernet">
Nov 11 00:13:15 user nova-compute[75279]:   <mac address="fa:16:3e:d3:58:35"/>
Nov 11 00:13:15 user nova-compute[75279]:   <model type="virtio"/>
Nov 11 00:13:15 user nova-compute[75279]:   <mtu size="1442"/>
Nov 11 00:13:15 user nova-compute[75279]:   <target dev="tap9b4b49ac-6d"/>
Nov 11 00:13:15 user nova-compute[75279]: </interface>
Nov 11 00:13:15 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Start waiting for the detach event from libvirt for device tap9b4b49ac-6d with device alias net1 for instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] No waiting events found dispatching network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:16 user nova-compute[75279]: WARNING nova.compute.manager [req-cdc9c350-7c11-4a22-9bde-707742abc75f req-c06ee7bb-2c84-4525-a314-9cf7a5751158 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received unexpected event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f for instance with vm_state building and task_state spawning.
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-unplugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-unplugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:16 user nova-compute[75279]: WARNING nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-unplugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c for instance with vm_state active and task_state None.
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:16 user nova-compute[75279]: WARNING nova.compute.manager [req-282e25c2-7152-4e26-b89e-3619e8faa98c req-fbb60aa2-408e-4f31-9802-f56cbb1be527 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-9b4b49ac-6d84-41c9-8e94-53a2b630a55c for instance with vm_state active and task_state None.
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] No waiting events found dispatching network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:13:18 user nova-compute[75279]: WARNING nova.compute.manager [req-a6c45e60-3d31-47f2-9c57-cc2d203d238a req-f4e72107-ea81-4106-aaa1-b652657b4eb1 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received unexpected event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f for instance with vm_state building and task_state spawning.
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:13:19 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Instance spawned successfully.
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:13:19 user nova-compute[75279]: INFO nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 11 00:13:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:13:19 user nova-compute[75279]: INFO nova.compute.manager [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Took 8.95 seconds to build instance.
Nov 11 00:13:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-11058ee4-1e17-4da5-a89a-3351696baf16 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.088s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:13:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:13:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbUCwyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:13:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:13:35 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca63b115-3d85-4d78-a9a5-7798592447d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:13:35 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[904317cb-52fa-4118-8335-4aba5150d8c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db] added
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed92417-2b14-4876-b702-d0583306bc01]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf5556-1183-446a-881a-c80f60a813a0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbUCwyxc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbUCwyxc" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f346a30-3118-4239-8e77-02012b2d44bd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zbUCwyxc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4788021-4097-420a-a64b-0b4106cfdf7b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[001aedcd-5627-4876-9afd-f93694e58d83]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c87584d-f946-4319-94de-62aab7cb05d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260]
Nov 11 00:13:35 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260] successful.
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49dd55a-ccc0-4873-95fa-7071d3728ddc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876cf5f-d430-4ae5-aad6-40b176ea0459]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:13:35 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:13:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c66e1-74d3-45fa-9535-708c6710f5c4]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbUCwyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:13:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:13:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Waiting for libvirt event about the detach of device tap9b4b49ac-6d with device alias net1 from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e is timed out.
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface>not found in domain: <domain type='kvm' id='28'>
Nov 11 00:13:36 user nova-compute[75279]:   <name>instance-00000016</name>
Nov 11 00:13:36 user nova-compute[75279]:   <uuid>7b70effe-d5d7-4df7-946e-4da6b7c2816e</uuid>
Nov 11 00:13:36 user nova-compute[75279]:   <metadata>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:36 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:12:20</nova:creationTime>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:36 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:36 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:36 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:port uuid="9b4b49ac-6d84-41c9-8e94-53a2b630a55c">
Nov 11 00:13:36 user nova-compute[75279]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 11 00:13:36 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:36 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:36 user nova-compute[75279]:   </metadata>
Nov 11 00:13:36 user nova-compute[75279]:   <memory unit='KiB'>524288</memory>
Nov 11 00:13:36 user nova-compute[75279]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 00:13:36 user nova-compute[75279]:   <vcpu placement='static'>1</vcpu>
Nov 11 00:13:36 user nova-compute[75279]:   <resource>
Nov 11 00:13:36 user nova-compute[75279]:     <partition>/machine</partition>
Nov 11 00:13:36 user nova-compute[75279]:   </resource>
Nov 11 00:13:36 user nova-compute[75279]:   <sysinfo type='smbios'>
Nov 11 00:13:36 user nova-compute[75279]:     <system>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='version'>0.0.0</entry>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='serial'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='uuid'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:36 user nova-compute[75279]:       <entry name='family'>Virtual Machine</entry>
Nov 11 00:13:36 user nova-compute[75279]:     </system>
Nov 11 00:13:36 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:36 user nova-compute[75279]:   <os>
Nov 11 00:13:36 user nova-compute[75279]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 00:13:36 user nova-compute[75279]:     <boot dev='hd'/>
Nov 11 00:13:36 user nova-compute[75279]:     <smbios mode='sysinfo'/>
Nov 11 00:13:36 user nova-compute[75279]:   </os>
Nov 11 00:13:36 user nova-compute[75279]:   <features>
Nov 11 00:13:36 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:36 user nova-compute[75279]:     <apic/>
Nov 11 00:13:36 user nova-compute[75279]:     <vmcoreinfo state='on'/>
Nov 11 00:13:36 user nova-compute[75279]:   </features>
Nov 11 00:13:36 user nova-compute[75279]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 00:13:36 user nova-compute[75279]:     <model fallback='forbid'>Nehalem</model>
Nov 11 00:13:36 user nova-compute[75279]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 00:13:36 user nova-compute[75279]:     <feature policy='require' name='vme'/>
Nov 11 00:13:36 user nova-compute[75279]:     <feature policy='require' name='x2apic'/>
Nov 11 00:13:36 user nova-compute[75279]:     <feature policy='require' name='hypervisor'/>
Nov 11 00:13:36 user nova-compute[75279]:   </cpu>
Nov 11 00:13:36 user nova-compute[75279]:   <clock offset='utc'>
Nov 11 00:13:36 user nova-compute[75279]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 00:13:36 user nova-compute[75279]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 00:13:36 user nova-compute[75279]:     <timer name='hpet' present='no'/>
Nov 11 00:13:36 user nova-compute[75279]:   </clock>
Nov 11 00:13:36 user nova-compute[75279]:   <on_poweroff>destroy</on_poweroff>
Nov 11 00:13:36 user nova-compute[75279]:   <on_reboot>restart</on_reboot>
Nov 11 00:13:36 user nova-compute[75279]:   <on_crash>destroy</on_crash>
Nov 11 00:13:36 user nova-compute[75279]:   <devices>
Nov 11 00:13:36 user nova-compute[75279]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 00:13:36 user nova-compute[75279]:     <disk type='file' device='disk'>
Nov 11 00:13:36 user nova-compute[75279]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 00:13:36 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk' index='2'/>
Nov 11 00:13:36 user nova-compute[75279]:       <backingStore type='file' index='3'>
Nov 11 00:13:36 user nova-compute[75279]:         <format type='raw'/>
Nov 11 00:13:36 user nova-compute[75279]:         <source file='/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a'/>
Nov 11 00:13:36 user nova-compute[75279]:         <backingStore/>
Nov 11 00:13:36 user nova-compute[75279]:       </backingStore>
Nov 11 00:13:36 user nova-compute[75279]:       <target dev='vda' bus='virtio'/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='virtio-disk0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </disk>
Nov 11 00:13:36 user nova-compute[75279]:     <disk type='file' device='cdrom'>
Nov 11 00:13:36 user nova-compute[75279]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 00:13:36 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config' index='1'/>
Nov 11 00:13:36 user nova-compute[75279]:       <backingStore/>
Nov 11 00:13:36 user nova-compute[75279]:       <target dev='hda' bus='ide'/>
Nov 11 00:13:36 user nova-compute[75279]:       <readonly/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='ide0-0-0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </disk>
Nov 11 00:13:36 user nova-compute[75279]:     <controller type='usb' index='0' model='none'>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='usb'/>
Nov 11 00:13:36 user nova-compute[75279]:     </controller>
Nov 11 00:13:36 user nova-compute[75279]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='pci.0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </controller>
Nov 11 00:13:36 user nova-compute[75279]:     <controller type='ide' index='0'>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='ide'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 00:13:36 user nova-compute[75279]:     </controller>
Nov 11 00:13:36 user nova-compute[75279]:     <interface type='ethernet'>
Nov 11 00:13:36 user nova-compute[75279]:       <mac address='fa:16:3e:49:67:ac'/>
Nov 11 00:13:36 user nova-compute[75279]:       <target dev='tap72682323-e4'/>
Nov 11 00:13:36 user nova-compute[75279]:       <model type='virtio'/>
Nov 11 00:13:36 user nova-compute[75279]:       <mtu size='1442'/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='net0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </interface>
Nov 11 00:13:36 user nova-compute[75279]:     <serial type='pty'>
Nov 11 00:13:36 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:36 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:36 user nova-compute[75279]:       <target type='isa-serial' port='0'>
Nov 11 00:13:36 user nova-compute[75279]:         <model name='isa-serial'/>
Nov 11 00:13:36 user nova-compute[75279]:       </target>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </serial>
Nov 11 00:13:36 user nova-compute[75279]:     <console type='pty' tty='/dev/pts/3'>
Nov 11 00:13:36 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:36 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:36 user nova-compute[75279]:       <target type='serial' port='0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </console>
Nov 11 00:13:36 user nova-compute[75279]:     <input type='mouse' bus='ps2'>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='input0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </input>
Nov 11 00:13:36 user nova-compute[75279]:     <input type='keyboard' bus='ps2'>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='input1'/>
Nov 11 00:13:36 user nova-compute[75279]:     </input>
Nov 11 00:13:36 user nova-compute[75279]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 11 00:13:36 user nova-compute[75279]:       <listen type='address' address='0.0.0.0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </graphics>
Nov 11 00:13:36 user nova-compute[75279]:     <audio id='1' type='none'/>
Nov 11 00:13:36 user nova-compute[75279]:     <video>
Nov 11 00:13:36 user nova-compute[75279]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='video0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </video>
Nov 11 00:13:36 user nova-compute[75279]:     <memballoon model='virtio'>
Nov 11 00:13:36 user nova-compute[75279]:       <stats period='10'/>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='balloon0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:36 user nova-compute[75279]:     <rng model='virtio'>
Nov 11 00:13:36 user nova-compute[75279]:       <backend model='random'>/dev/urandom</backend>
Nov 11 00:13:36 user nova-compute[75279]:       <alias name='rng0'/>
Nov 11 00:13:36 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 00:13:36 user nova-compute[75279]:     </rng>
Nov 11 00:13:36 user nova-compute[75279]:   </devices>
Nov 11 00:13:36 user nova-compute[75279]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 00:13:36 user nova-compute[75279]:     <label>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</label>
Nov 11 00:13:36 user nova-compute[75279]:     <imagelabel>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</imagelabel>
Nov 11 00:13:36 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:36 user nova-compute[75279]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 00:13:36 user nova-compute[75279]:     <label>+64055:+108</label>
Nov 11 00:13:36 user nova-compute[75279]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 00:13:36 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:36 user nova-compute[75279]: </domain>
Nov 11 00:13:36 user nova-compute[75279]:  {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 00:13:36 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully detached device tap9b4b49ac-6d from instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e from the live domain config.
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG os_vif [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b4b49ac-6d, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a042c925-e2ef-4baf-af9f-511cf7ca2341) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=25.179889678955078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:13:36 user nova-compute[75279]: INFO os_vif [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d')
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:36 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:13:36</nova:creationTime>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:36 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:36 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:36 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:36 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:36 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:36 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:36 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:36 user nova-compute[75279]:  {{(pid=75279) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23765613162663361', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613162663361', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e685210c-addc-45e1-a665-ab603c5f3340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:13:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:13:36 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:13:36 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:13:36 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:13:36 user nova-compute[75279]:   <serial>58293abc-c375-4c99-b4a2-61d4976913db</serial>
Nov 11 00:13:36 user nova-compute[75279]: </disk>
Nov 11 00:13:36 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-deleted-9b4b49ac-6d84-41c9-8e94-53a2b630a55c {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:13:37 user nova-compute[75279]: INFO nova.compute.manager [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Neutron deleted interface 9b4b49ac-6d84-41c9-8e94-53a2b630a55c; detaching it from the instance and deleting it from the info cache
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.neutron [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquired lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.objects.instance [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Lazy-loading 'system_metadata' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] No VIF found with MAC fa:16:3e:2d:4d:d4, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.objects.instance [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Lazy-loading 'flavor' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.objects.base [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Object Instance<7b70effe-d5d7-4df7-946e-4da6b7c2816e> lazy-loaded attributes: system_metadata,flavor {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface>not found in domain: <domain type='kvm' id='28'>
Nov 11 00:13:37 user nova-compute[75279]:   <name>instance-00000016</name>
Nov 11 00:13:37 user nova-compute[75279]:   <uuid>7b70effe-d5d7-4df7-946e-4da6b7c2816e</uuid>
Nov 11 00:13:37 user nova-compute[75279]:   <metadata>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:37 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:13:36</nova:creationTime>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:37 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:37 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:37 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:37 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:37 user nova-compute[75279]:   </metadata>
Nov 11 00:13:37 user nova-compute[75279]:   <memory unit='KiB'>524288</memory>
Nov 11 00:13:37 user nova-compute[75279]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 00:13:37 user nova-compute[75279]:   <vcpu placement='static'>1</vcpu>
Nov 11 00:13:37 user nova-compute[75279]:   <resource>
Nov 11 00:13:37 user nova-compute[75279]:     <partition>/machine</partition>
Nov 11 00:13:37 user nova-compute[75279]:   </resource>
Nov 11 00:13:37 user nova-compute[75279]:   <sysinfo type='smbios'>
Nov 11 00:13:37 user nova-compute[75279]:     <system>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='version'>0.0.0</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='serial'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='uuid'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='family'>Virtual Machine</entry>
Nov 11 00:13:37 user nova-compute[75279]:     </system>
Nov 11 00:13:37 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:37 user nova-compute[75279]:   <os>
Nov 11 00:13:37 user nova-compute[75279]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 00:13:37 user nova-compute[75279]:     <boot dev='hd'/>
Nov 11 00:13:37 user nova-compute[75279]:     <smbios mode='sysinfo'/>
Nov 11 00:13:37 user nova-compute[75279]:   </os>
Nov 11 00:13:37 user nova-compute[75279]:   <features>
Nov 11 00:13:37 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:37 user nova-compute[75279]:     <apic/>
Nov 11 00:13:37 user nova-compute[75279]:     <vmcoreinfo state='on'/>
Nov 11 00:13:37 user nova-compute[75279]:   </features>
Nov 11 00:13:37 user nova-compute[75279]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 00:13:37 user nova-compute[75279]:     <model fallback='forbid'>Nehalem</model>
Nov 11 00:13:37 user nova-compute[75279]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='vme'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='x2apic'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='hypervisor'/>
Nov 11 00:13:37 user nova-compute[75279]:   </cpu>
Nov 11 00:13:37 user nova-compute[75279]:   <clock offset='utc'>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='hpet' present='no'/>
Nov 11 00:13:37 user nova-compute[75279]:   </clock>
Nov 11 00:13:37 user nova-compute[75279]:   <on_poweroff>destroy</on_poweroff>
Nov 11 00:13:37 user nova-compute[75279]:   <on_reboot>restart</on_reboot>
Nov 11 00:13:37 user nova-compute[75279]:   <on_crash>destroy</on_crash>
Nov 11 00:13:37 user nova-compute[75279]:   <devices>
Nov 11 00:13:37 user nova-compute[75279]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 00:13:37 user nova-compute[75279]:     <disk type='file' device='disk'>
Nov 11 00:13:37 user nova-compute[75279]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 00:13:37 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk' index='2'/>
Nov 11 00:13:37 user nova-compute[75279]:       <backingStore type='file' index='3'>
Nov 11 00:13:37 user nova-compute[75279]:         <format type='raw'/>
Nov 11 00:13:37 user nova-compute[75279]:         <source file='/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a'/>
Nov 11 00:13:37 user nova-compute[75279]:         <backingStore/>
Nov 11 00:13:37 user nova-compute[75279]:       </backingStore>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='vda' bus='virtio'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='virtio-disk0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </disk>
Nov 11 00:13:37 user nova-compute[75279]:     <disk type='file' device='cdrom'>
Nov 11 00:13:37 user nova-compute[75279]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 00:13:37 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config' index='1'/>
Nov 11 00:13:37 user nova-compute[75279]:       <backingStore/>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='hda' bus='ide'/>
Nov 11 00:13:37 user nova-compute[75279]:       <readonly/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='ide0-0-0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </disk>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='usb' index='0' model='none'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='usb'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='pci.0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='ide' index='0'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='ide'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <interface type='ethernet'>
Nov 11 00:13:37 user nova-compute[75279]:       <mac address='fa:16:3e:49:67:ac'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='tap72682323-e4'/>
Nov 11 00:13:37 user nova-compute[75279]:       <model type='virtio'/>
Nov 11 00:13:37 user nova-compute[75279]:       <mtu size='1442'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='net0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </interface>
Nov 11 00:13:37 user nova-compute[75279]:     <serial type='pty'>
Nov 11 00:13:37 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:37 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target type='isa-serial' port='0'>
Nov 11 00:13:37 user nova-compute[75279]:         <model name='isa-serial'/>
Nov 11 00:13:37 user nova-compute[75279]:       </target>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </serial>
Nov 11 00:13:37 user nova-compute[75279]:     <console type='pty' tty='/dev/pts/3'>
Nov 11 00:13:37 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:37 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target type='serial' port='0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </console>
Nov 11 00:13:37 user nova-compute[75279]:     <input type='mouse' bus='ps2'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='input0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </input>
Nov 11 00:13:37 user nova-compute[75279]:     <input type='keyboard' bus='ps2'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='input1'/>
Nov 11 00:13:37 user nova-compute[75279]:     </input>
Nov 11 00:13:37 user nova-compute[75279]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 11 00:13:37 user nova-compute[75279]:       <listen type='address' address='0.0.0.0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </graphics>
Nov 11 00:13:37 user nova-compute[75279]:     <audio id='1' type='none'/>
Nov 11 00:13:37 user nova-compute[75279]:     <video>
Nov 11 00:13:37 user nova-compute[75279]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='video0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </video>
Nov 11 00:13:37 user nova-compute[75279]:     <memballoon model='virtio'>
Nov 11 00:13:37 user nova-compute[75279]:       <stats period='10'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='balloon0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:37 user nova-compute[75279]:     <rng model='virtio'>
Nov 11 00:13:37 user nova-compute[75279]:       <backend model='random'>/dev/urandom</backend>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='rng0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </rng>
Nov 11 00:13:37 user nova-compute[75279]:   </devices>
Nov 11 00:13:37 user nova-compute[75279]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 00:13:37 user nova-compute[75279]:     <label>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</label>
Nov 11 00:13:37 user nova-compute[75279]:     <imagelabel>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</imagelabel>
Nov 11 00:13:37 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:37 user nova-compute[75279]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 00:13:37 user nova-compute[75279]:     <label>+64055:+108</label>
Nov 11 00:13:37 user nova-compute[75279]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 00:13:37 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:37 user nova-compute[75279]: </domain>
Nov 11 00:13:37 user nova-compute[75279]:  {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface> {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d3:58:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap9b4b49ac-6d"/></interface>not found in domain: <domain type='kvm' id='28'>
Nov 11 00:13:37 user nova-compute[75279]:   <name>instance-00000016</name>
Nov 11 00:13:37 user nova-compute[75279]:   <uuid>7b70effe-d5d7-4df7-946e-4da6b7c2816e</uuid>
Nov 11 00:13:37 user nova-compute[75279]:   <metadata>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:37 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:13:36</nova:creationTime>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:37 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:37 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:37 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:37 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:37 user nova-compute[75279]:   </metadata>
Nov 11 00:13:37 user nova-compute[75279]:   <memory unit='KiB'>524288</memory>
Nov 11 00:13:37 user nova-compute[75279]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 11 00:13:37 user nova-compute[75279]:   <vcpu placement='static'>1</vcpu>
Nov 11 00:13:37 user nova-compute[75279]:   <resource>
Nov 11 00:13:37 user nova-compute[75279]:     <partition>/machine</partition>
Nov 11 00:13:37 user nova-compute[75279]:   </resource>
Nov 11 00:13:37 user nova-compute[75279]:   <sysinfo type='smbios'>
Nov 11 00:13:37 user nova-compute[75279]:     <system>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='product'>OpenStack Nova</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='version'>0.0.0</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='serial'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='uuid'>7b70effe-d5d7-4df7-946e-4da6b7c2816e</entry>
Nov 11 00:13:37 user nova-compute[75279]:       <entry name='family'>Virtual Machine</entry>
Nov 11 00:13:37 user nova-compute[75279]:     </system>
Nov 11 00:13:37 user nova-compute[75279]:   </sysinfo>
Nov 11 00:13:37 user nova-compute[75279]:   <os>
Nov 11 00:13:37 user nova-compute[75279]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 11 00:13:37 user nova-compute[75279]:     <boot dev='hd'/>
Nov 11 00:13:37 user nova-compute[75279]:     <smbios mode='sysinfo'/>
Nov 11 00:13:37 user nova-compute[75279]:   </os>
Nov 11 00:13:37 user nova-compute[75279]:   <features>
Nov 11 00:13:37 user nova-compute[75279]:     <acpi/>
Nov 11 00:13:37 user nova-compute[75279]:     <apic/>
Nov 11 00:13:37 user nova-compute[75279]:     <vmcoreinfo state='on'/>
Nov 11 00:13:37 user nova-compute[75279]:   </features>
Nov 11 00:13:37 user nova-compute[75279]:   <cpu mode='custom' match='exact' check='full'>
Nov 11 00:13:37 user nova-compute[75279]:     <model fallback='forbid'>Nehalem</model>
Nov 11 00:13:37 user nova-compute[75279]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='vme'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='x2apic'/>
Nov 11 00:13:37 user nova-compute[75279]:     <feature policy='require' name='hypervisor'/>
Nov 11 00:13:37 user nova-compute[75279]:   </cpu>
Nov 11 00:13:37 user nova-compute[75279]:   <clock offset='utc'>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='pit' tickpolicy='delay'/>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 11 00:13:37 user nova-compute[75279]:     <timer name='hpet' present='no'/>
Nov 11 00:13:37 user nova-compute[75279]:   </clock>
Nov 11 00:13:37 user nova-compute[75279]:   <on_poweroff>destroy</on_poweroff>
Nov 11 00:13:37 user nova-compute[75279]:   <on_reboot>restart</on_reboot>
Nov 11 00:13:37 user nova-compute[75279]:   <on_crash>destroy</on_crash>
Nov 11 00:13:37 user nova-compute[75279]:   <devices>
Nov 11 00:13:37 user nova-compute[75279]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 11 00:13:37 user nova-compute[75279]:     <disk type='file' device='disk'>
Nov 11 00:13:37 user nova-compute[75279]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 11 00:13:37 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk' index='2'/>
Nov 11 00:13:37 user nova-compute[75279]:       <backingStore type='file' index='3'>
Nov 11 00:13:37 user nova-compute[75279]:         <format type='raw'/>
Nov 11 00:13:37 user nova-compute[75279]:         <source file='/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a'/>
Nov 11 00:13:37 user nova-compute[75279]:         <backingStore/>
Nov 11 00:13:37 user nova-compute[75279]:       </backingStore>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='vda' bus='virtio'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='virtio-disk0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </disk>
Nov 11 00:13:37 user nova-compute[75279]:     <disk type='file' device='cdrom'>
Nov 11 00:13:37 user nova-compute[75279]:       <driver name='qemu' type='raw' cache='none'/>
Nov 11 00:13:37 user nova-compute[75279]:       <source file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/disk.config' index='1'/>
Nov 11 00:13:37 user nova-compute[75279]:       <backingStore/>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='hda' bus='ide'/>
Nov 11 00:13:37 user nova-compute[75279]:       <readonly/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='ide0-0-0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </disk>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='usb' index='0' model='none'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='usb'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='pci' index='0' model='pci-root'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='pci.0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <controller type='ide' index='0'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='ide'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 11 00:13:37 user nova-compute[75279]:     </controller>
Nov 11 00:13:37 user nova-compute[75279]:     <interface type='ethernet'>
Nov 11 00:13:37 user nova-compute[75279]:       <mac address='fa:16:3e:49:67:ac'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target dev='tap72682323-e4'/>
Nov 11 00:13:37 user nova-compute[75279]:       <model type='virtio'/>
Nov 11 00:13:37 user nova-compute[75279]:       <mtu size='1442'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='net0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </interface>
Nov 11 00:13:37 user nova-compute[75279]:     <serial type='pty'>
Nov 11 00:13:37 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:37 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target type='isa-serial' port='0'>
Nov 11 00:13:37 user nova-compute[75279]:         <model name='isa-serial'/>
Nov 11 00:13:37 user nova-compute[75279]:       </target>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </serial>
Nov 11 00:13:37 user nova-compute[75279]:     <console type='pty' tty='/dev/pts/3'>
Nov 11 00:13:37 user nova-compute[75279]:       <source path='/dev/pts/3'/>
Nov 11 00:13:37 user nova-compute[75279]:       <log file='/opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e/console.log' append='off'/>
Nov 11 00:13:37 user nova-compute[75279]:       <target type='serial' port='0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='serial0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </console>
Nov 11 00:13:37 user nova-compute[75279]:     <input type='mouse' bus='ps2'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='input0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </input>
Nov 11 00:13:37 user nova-compute[75279]:     <input type='keyboard' bus='ps2'>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='input1'/>
Nov 11 00:13:37 user nova-compute[75279]:     </input>
Nov 11 00:13:37 user nova-compute[75279]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 11 00:13:37 user nova-compute[75279]:       <listen type='address' address='0.0.0.0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </graphics>
Nov 11 00:13:37 user nova-compute[75279]:     <audio id='1' type='none'/>
Nov 11 00:13:37 user nova-compute[75279]:     <video>
Nov 11 00:13:37 user nova-compute[75279]:       <model type='virtio' heads='1' primary='yes'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='video0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </video>
Nov 11 00:13:37 user nova-compute[75279]:     <memballoon model='virtio'>
Nov 11 00:13:37 user nova-compute[75279]:       <stats period='10'/>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='balloon0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </memballoon>
Nov 11 00:13:37 user nova-compute[75279]:     <rng model='virtio'>
Nov 11 00:13:37 user nova-compute[75279]:       <backend model='random'>/dev/urandom</backend>
Nov 11 00:13:37 user nova-compute[75279]:       <alias name='rng0'/>
Nov 11 00:13:37 user nova-compute[75279]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 11 00:13:37 user nova-compute[75279]:     </rng>
Nov 11 00:13:37 user nova-compute[75279]:   </devices>
Nov 11 00:13:37 user nova-compute[75279]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 11 00:13:37 user nova-compute[75279]:     <label>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</label>
Nov 11 00:13:37 user nova-compute[75279]:     <imagelabel>libvirt-7b70effe-d5d7-4df7-946e-4da6b7c2816e</imagelabel>
Nov 11 00:13:37 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:37 user nova-compute[75279]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 11 00:13:37 user nova-compute[75279]:     <label>+64055:+108</label>
Nov 11 00:13:37 user nova-compute[75279]:     <imagelabel>+64055:+108</imagelabel>
Nov 11 00:13:37 user nova-compute[75279]:   </seclabel>
Nov 11 00:13:37 user nova-compute[75279]: </domain>
Nov 11 00:13:37 user nova-compute[75279]:  {{(pid=75279) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 11 00:13:37 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Detaching interface fa:16:3e:d3:58:35 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap9b4b49ac-6d' not found.
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Converting VIF {"id": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "address": "fa:16:3e:d3:58:35", "network": {"id": "cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1469745607", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b4b49ac-6d", "ovs_interfaceid": "9b4b49ac-6d84-41c9-8e94-53a2b630a55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG os_vif [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b4b49ac-6d, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:13:37 user nova-compute[75279]: INFO os_vif [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:58:35,bridge_name='br-int',has_traffic_filtering=True,id=9b4b49ac-6d84-41c9-8e94-53a2b630a55c,network=Network(cfe5cd65-178f-44ab-acdd-57e6ab0e3f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b4b49ac-6d')
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [req-d60f4669-69dd-4d1e-853d-3a0398f60321 req-04cf4987-cbf6-468c-aae7-71a3d31d6331 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:13:37 user nova-compute[75279]:   <nova:package version="0.0.0"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:name>tempest-device-tagging-server-316080259</nova:name>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:creationTime>2023-11-11 00:13:37</nova:creationTime>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:flavor name="m1.tiny">
Nov 11 00:13:37 user nova-compute[75279]:     <nova:memory>512</nova:memory>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:disk>1</nova:disk>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:swap>0</nova:swap>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:vcpus>1</nova:vcpus>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:flavor>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:user uuid="8d2cf04159da4f1986f253dc994074d1">tempest-TaggedAttachmentsTest-989099799-project-member</nova:user>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:project uuid="6b1b87e530aa40a2a74947ac0baccc2f">tempest-TaggedAttachmentsTest-989099799</nova:project>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:owner>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:13:37 user nova-compute[75279]:   <nova:ports>
Nov 11 00:13:37 user nova-compute[75279]:     <nova:port uuid="72682323-e45b-4a04-9e61-06dbe1924488">
Nov 11 00:13:37 user nova-compute[75279]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:13:37 user nova-compute[75279]:     </nova:port>
Nov 11 00:13:37 user nova-compute[75279]:   </nova:ports>
Nov 11 00:13:37 user nova-compute[75279]: </nova:instance>
Nov 11 00:13:37 user nova-compute[75279]:  {{(pid=75279) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c6a81c8-69a6-4d68-9630-a2b531bf9a32 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.184s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:37 user nova-compute[75279]: INFO nova.network.neutron [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Port 9b4b49ac-6d84-41c9-8e94-53a2b630a55c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 11 00:13:37 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [{"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Releasing lock "refresh_cache-7b70effe-d5d7-4df7-946e-4da6b7c2816e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b134040-8921-416f-8640-9c9d92304ad1 tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "interface-7b70effe-d5d7-4df7-946e-4da6b7c2816e-9b4b49ac-6d84-41c9-8e94-53a2b630a55c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.091s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:13:39 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [{"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-2bb536aa-c923-4be4-a399-e5f1270bf463" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:13:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:13:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'flavor' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.179s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:05 user nova-compute[75279]: INFO nova.compute.manager [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attaching volume a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e to /dev/vdb
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.utils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f01f8-bd86-4125-8b72-d37cad54b035]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831985c-7851-4266-a28a-84fec66bf93c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba9bc3-9c7d-4afc-83b8-31dd17cd907f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8663133-aba6-4302-9502-783bf0ed38e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:14:05 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:14:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5069e03-0c1f-4a95-a006-1d6d35deadbc]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG os_brick.utils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:14:05 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating existing volume attachment record: d3a190d8-51aa-4aff-9d3a-58958f9d1a8d {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:06 user nova-compute[75279]: INFO nova.compute.manager [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Terminating instance
Nov 11 00:14:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-unplugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-unplugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-e569a7e2-10ab-4863-8c2f-50876211b819 req-765e8eed-9318-4226-975b-650bcab05fb8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-unplugged-72682323-e45b-4a04-9e61-06dbe1924488 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Instance destroyed successfully.
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lazy-loading 'resources' on Instance uuid 7b70effe-d5d7-4df7-946e-4da6b7c2816e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-11T00:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-316080259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-316080259',id=22,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUwtu4u8dTz/XPNR1SwlKUNWkbRva99WMWnCyf3akqYRE/1YVmied7fYAOpJzjOwFhpQuVOIgS8391eYCguGbGIZtQPeqm+n5JlQlhUGMwotiH7VINNMKEhFpvQ1tdSAA==',key_name='tempest-keypair-791130823',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1b87e530aa40a2a74947ac0baccc2f',ramdisk_id='',reservation_id='r-09daamhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-989099799',owner_user_name='tempest-TaggedAttachmentsTest-989099799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2cf04159da4f1986f253dc994074d1',uuid=7b70effe-d5d7-4df7-946e-4da6b7c2816e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converting VIF {"id": "72682323-e45b-4a04-9e61-06dbe1924488", "address": "fa:16:3e:49:67:ac", "network": {"id": "7397462b-934f-4367-a5f8-93311984862e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-101231974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1b87e530aa40a2a74947ac0baccc2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72682323-e4", "ovs_interfaceid": "72682323-e45b-4a04-9e61-06dbe1924488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG os_vif [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72682323-e4, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=808234f8-39d3-40b0-90f0-1e41963b67b2) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:07 user nova-compute[75279]: INFO os_vif [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=72682323-e45b-4a04-9e61-06dbe1924488,network=Network(7397462b-934f-4367-a5f8-93311984862e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72682323-e4')
Nov 11 00:14:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Deleting instance files /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e_del
Nov 11 00:14:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Deletion of /opt/stack/data/nova/instances/7b70effe-d5d7-4df7-946e-4da6b7c2816e_del complete
Nov 11 00:14:07 user nova-compute[75279]: INFO nova.compute.manager [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 11 00:14:07 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:14:07 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:14:08 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:08 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Took 1.19 seconds to deallocate network for instance.
Nov 11 00:14:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-f7ea34c2-1479-4cce-a4ea-d2c2794addea req-593d1c41-257b-4645-93d7-46fee66bc0d8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-deleted-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:08 user nova-compute[75279]: INFO nova.compute.manager [req-f7ea34c2-1479-4cce-a4ea-d2c2794addea req-593d1c41-257b-4645-93d7-46fee66bc0d8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Neutron deleted interface 72682323-e45b-4a04-9e61-06dbe1924488; detaching it from the instance and deleting it from the info cache
Nov 11 00:14:08 user nova-compute[75279]: DEBUG nova.network.neutron [req-f7ea34c2-1479-4cce-a4ea-d2c2794addea req-593d1c41-257b-4645-93d7-46fee66bc0d8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-f7ea34c2-1479-4cce-a4ea-d2c2794addea req-593d1c41-257b-4645-93d7-46fee66bc0d8 service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Detach interface failed, port_id=72682323-e45b-4a04-9e61-06dbe1924488, reason: Instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] Acquiring lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] No waiting events found dispatching network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:09 user nova-compute[75279]: WARNING nova.compute.manager [req-d55ea855-9abe-41ac-a627-8bb7cdcbee20 req-75a15885-9660-4c43-ace4-c5f16786524d service nova] [instance: 7b70effe-d5d7-4df7-946e-4da6b7c2816e] Received unexpected event network-vif-plugged-72682323-e45b-4a04-9e61-06dbe1924488 for instance with vm_state deleted and task_state None.
Nov 11 00:14:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:09 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Deleted allocations for instance 7b70effe-d5d7-4df7-946e-4da6b7c2816e
Nov 11 00:14:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e37b3171-7b70-4ed8-a0bc-67fa0138f88f tempest-TaggedAttachmentsTest-989099799 tempest-TaggedAttachmentsTest-989099799-project-member] Lock "7b70effe-d5d7-4df7-946e-4da6b7c2816e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-changed-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Refreshing instance network info cache due to event network-changed-90f983f8-1933-45e1-8366-2c4fefa038d4. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] Acquiring lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] Acquired lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Refreshing network info cache for port 90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:14:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:13 user nova-compute[75279]: DEBUG nova.network.neutron [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updated VIF entry in instance network info cache for port 90f983f8-1933-45e1-8366-2c4fefa038d4. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:14:13 user nova-compute[75279]: DEBUG nova.network.neutron [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updating instance_info_cache with network_info: [{"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c0fb83a6-c454-4d78-90cb-faf095645f74 req-51b94472-4c48-4f5e-911e-840d2b3e75e1 service nova] Releasing lock "refresh_cache-600c2f85-9476-48eb-b37f-7e845469fc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:14:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing instance network info cache due to event network-changed-534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:14:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:30 user nova-compute[75279]: DEBUG nova.network.neutron [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Refreshing network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:14:31 user nova-compute[75279]: DEBUG nova.network.neutron [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated VIF entry in instance network info cache for port 534db674-6cbc-4e0b-b7fe-25c317603b29. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:14:31 user nova-compute[75279]: DEBUG nova.network.neutron [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9055f3c-ab4f-4450-8a5c-39dd9fbb3b8f req-2e489f97-0002-4922-bef4-0d6c1883600c service nova] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Stashing vm_state: active {{(pid=75279) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-changed-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Refreshing instance network info cache due to event network-changed-71c32096-1127-4b3b-b506-b52ae75f2951. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Refreshing network info cache for port 71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:14:32 user nova-compute[75279]: INFO nova.compute.claims [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Claim successful on node user
Nov 11 00:14:32 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating resource usage from migration b8f8b380-62e1-4633-af9b-a77738d1c507
Nov 11 00:14:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updated VIF entry in instance network info cache for port 71c32096-1127-4b3b-b506-b52ae75f2951. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-66f39832-3bdf-484a-865a-931a85217a53 req-7802697e-36b0-4454-a366-305105a5016b service nova] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.670s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:33 user nova-compute[75279]: INFO nova.compute.manager [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Migrating
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:33 user nova-compute[75279]: INFO nova.compute.rpcapi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Starting migrate_disk_and_power_off {{(pid=75279) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:34 user nova-compute[75279]: WARNING nova.compute.manager [req-13e05520-223f-45f4-98d0-f5d6252ab38e req-793fd03a-00c1-4c4b-bf0a-1f4bfc7abe66 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state active and task_state resize_migrating.
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance destroyed successfully.
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:13:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71c32096-11, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1d452b1-004f-4e0f-bcd0-3be225ba9331) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:35 user nova-compute[75279]: INFO os_vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11')
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:14:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a2562-be28-4066-9c87-979e88e6a9cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:14:35 user nova-compute[75279]: No targets found.
Nov 11 00:14:35 user nova-compute[75279]: iSNS:
Nov 11 00:14:35 user nova-compute[75279]: No targets found.
Nov 11 00:14:35 user nova-compute[75279]: STATIC:
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40
Nov 11 00:14:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:14:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:14:35 user nova-compute[75279]: FIRMWARE:
Nov 11 00:14:35 user nova-compute[75279]: No targets found.
Nov 11 00:14:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:14:35 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:14:35 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[983e9cf4-88e2-4a81-84e4-fab9c7ea9d9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[27363f9f-b447-4976-9284-4cf781f7d144]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:35 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e01b0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc32ee-ff57-4263-8223-c4376b29e5bc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[28325b24-c676-4108-a9e0-138fe1f40cf9]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[320adfb0-a542-4014-96a6-a6da53adfe92]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[612672ec-6cee-4722-9147-9cda5ed69be5]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd990bb0-585b-4f9a-8654-a727b1dab079]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7008b04-becb-4bed-84e4-2e3452a9f818]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]
Nov 11 00:14:35 user nova-compute[75279]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.
Nov 11 00:14:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2db8d2-e082-4cd4-a27b-07f85f375d05]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.502s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== disconnect_volume: return (504ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:14:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:36 user nova-compute[75279]: WARNING nova.compute.manager [req-a614d038-d3f2-4484-8105-74ea518446bf req-6442083b-4897-4f16-b1e9-e1a5816f9d1a service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state active and task_state resize_migrating.
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:14:37 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:37 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7395MB free_disk=25.168136596679688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 as it has an incoming, in-progress migration b8f8b380-62e1-4633-af9b-a77738d1c507. Migration status is migrating {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:14:37 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating resource usage from migration b8f8b380-62e1-4633-af9b-a77738d1c507
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e685210c-addc-45e1-a665-ab603c5f3340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration b8f8b380-62e1-4633-af9b-a77738d1c507 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:14:37 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:14:38 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:14:38 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:14:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:14:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:14:39 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:14:39 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:14:39 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a53fbc-b74d-4e87-b941-c4fec3cb40bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:14:39 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96211a39-45f1-445f-8dc0-b1f7472d2517]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e] added
Nov 11 00:14:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c2140f-286c-48e2-85db-457d4ca52444]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9282e0b-1431-4eab-99ac-3083eaeca156]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxdpNnVS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxdpNnVS" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b16bbf-a6a2-44af-ab8d-fb252afe7924]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxdpNnVS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd8529-7f50-4feb-a8ee-0c04b0a6cb91]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410de0a-7204-4139-aa2e-db7663fffaf6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:39 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:39 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:14:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [{"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a77456b7-3d4c-40a9-94f7-661efc298e50" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG nova.objects.instance [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'flavor' on Instance uuid 600c2f85-9476-48eb-b37f-7e845469fc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:40 user nova-compute[75279]: INFO nova.compute.manager [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Attaching volume 155d19ec-8b72-4a0e-94b8-d4d90ce5bf09 to /dev/vdb
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e073c-496b-4ad0-b38a-b4926ace30bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f92c0-89e0-4a79-b1ad-10e50100c573]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6129e0-5c6c-42a2-8b4c-b247d6d072d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc366d-4eed-4a95-b472-a650aab71f04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:14:40 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:14:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd732a4-4f30-42f5-a4e9-70de48f89ab2]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:14:40 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updating existing volume attachment record: 421f1399-d35c-423c-8c75-fb08b1b163c5 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --login" returned: 0 in 1.086s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd15dd2-f332-45fa-991d-c02cb7b341fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260]
Nov 11 00:14:41 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260] successful.
Nov 11 00:14:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f84bd1-3d22-4adf-8f74-bc24fab1fc82]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1e5f75-ac94-44c7-a882-d2d29398da6d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:14:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:139cd14f-4b68-4401-9bcc-a6b4a564dc40 (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abaeaa6a-4389-4300-beb3-2d0d93f063bd (non-flash)
Nov 11 00:14:41 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:14:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.390s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0a4be-b78a-478a-8366-016a944b7068]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:41 user nova-compute[75279]: INFO nova.compute.manager [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Detaching volume 58293abc-c375-4c99-b4a2-61d4976913db
Nov 11 00:14:42 user nova-compute[75279]: INFO nova.virt.block_device [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Attempting to driver detach volume 58293abc-c375-4c99-b4a2-61d4976913db from mountpoint /dev/vdb
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Attempting to detach device vdb from instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:14:42 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:14:42 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:14:42 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:14:42 user nova-compute[75279]:   <serial>58293abc-c375-4c99-b4a2-61d4976913db</serial>
Nov 11 00:14:42 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:14:42 user nova-compute[75279]: </disk>
Nov 11 00:14:42 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully detached device vdb from instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae from the persistent domain config.
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:14:42 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:14:42 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:14:42 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:14:42 user nova-compute[75279]:   <serial>58293abc-c375-4c99-b4a2-61d4976913db</serial>
Nov 11 00:14:42 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:14:42 user nova-compute[75279]: </disk>
Nov 11 00:14:42 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.431s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] <== connect_volume: return (2433ms) {'type': 'block', 'scsi_wwn': '23731396231636234', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731396231636234', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'flavor' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:14:42 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:14:42 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:14:42 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:14:42 user nova-compute[75279]:   <serial>a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e</serial>
Nov 11 00:14:42 user nova-compute[75279]: </disk>
Nov 11 00:14:42 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No VIF found with MAC fa:16:3e:77:95:e8, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0fe36e68-f232-4f83-81be-d1a8674e7ef6 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.314s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:14:43 user nova-compute[75279]: INFO nova.compute.manager [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Rescuing
Nov 11 00:14:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:44 user nova-compute[75279]: WARNING nova.compute.manager [req-29a22b38-0250-47e2-bcfc-1309912ceefe req-9003933a-2e1a-4f9c-a2ec-e6a59ab46fe2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state rescuing.
Nov 11 00:14:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance destroyed successfully.
Nov 11 00:14:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attempting a stable device rescue
Nov 11 00:14:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:14:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Creating image(s)
Nov 11 00:14:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG nova.virt.images [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] 91ff3945-34bd-4e46-889a-9aef6cdb8b43 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.part /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:46 user nova-compute[75279]: WARNING nova.compute.manager [req-7cce691d-6729-4ebe-8e5c-e0952567ab02 req-bd015b4f-be22-4ea7-9017-025d6290581f service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state rescuing.
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.part /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.converted" returned: 0 in 0.306s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.024s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65 --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65,backing_fmt=raw /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65,backing_fmt=raw /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue" returned: 0 in 0.051s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "e2090a8f14d39dc0d5a1b7df94e0742f0b523b65" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'migration_context' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Object Instance<9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start _get_guest_xml network_info=[{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "vif_mac": "fa:16:3e:77:95:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91ff3945-34bd-4e46-889a-9aef6cdb8b43', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'serial': 'a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': 'd3a190d8-51aa-4aff-9d3a-58958f9d1a8d', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'resources' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Object Instance<9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'numa_topology' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Object Instance<9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:14:47 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:47 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Object Instance<9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:14:47 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:14:47 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:14:47 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f777489-3cc8-4314-b4bf-90e519c9f690]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RxdpNnVS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 11 00:14:47 user nova-compute[75279]: node.name = iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:14:47 user nova-compute[75279]: node.tpgt = -1
Nov 11 00:14:47 user nova-compute[75279]: node.startup = automatic
Nov 11 00:14:47 user nova-compute[75279]: node.leading_login = No
Nov 11 00:14:47 user nova-compute[75279]: iface.iscsi_ifacename = default
Nov 11 00:14:47 user nova-compute[75279]: iface.net_ifacename = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.ipaddress = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.prefix_len = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.hwaddress = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.transport_name = tcp
Nov 11 00:14:47 user nova-compute[75279]: iface.initiatorname = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.vlan_id = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.vlan_priority = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.vlan_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.iface_num = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.mtu = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.port = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.bootproto = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.subnet_mask = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.gateway = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_alt_client_id_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_alt_client_id = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_dns = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_learn_iqn = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_req_vendor_id_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_vendor_id_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_vendor_id = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.dhcp_slp_da = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.fragmentation = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.gratuitous_arp = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.incoming_forwarding = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.tos_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.tos = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.ttl = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.delayed_ack = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.tcp_nagle = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.tcp_wsf_state = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.tcp_wsf = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.tcp_timer_scale = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.tcp_timestamp = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.redirect = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.def_task_mgmt_timeout = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.header_digest = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.data_digest = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.immediate_data = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.initial_r2t = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.data_seq_inorder = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.data_pdu_inorder = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.erl = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.max_receive_data_len = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.first_burst_len = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.max_outstanding_r2t = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.max_burst_len = 0
Nov 11 00:14:47 user nova-compute[75279]: iface.chap_auth = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.bidi_chap = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.strict_login_compliance = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.discovery_auth = <empty>
Nov 11 00:14:47 user nova-compute[75279]: iface.discovery_logout = <empty>
Nov 11 00:14:47 user nova-compute[75279]: node.discovery_address = <empty>
Nov 11 00:14:47 user nova-compute[75279]: node.discovery_port = 0
Nov 11 00:14:47 user nova-compute[75279]: node.discovery_type = static
Nov 11 00:14:47 user nova-compute[75279]: node.session.initial_cmdsn = 0
Nov 11 00:14:47 user nova-compute[75279]: node.session.initial_login_retry_max = 8
Nov 11 00:14:47 user nova-compute[75279]: node.session.xmit_thread_priority = -20
Nov 11 00:14:47 user nova-compute[75279]: node.session.cmds_max = 128
Nov 11 00:14:47 user nova-compute[75279]: node.session.queue_depth = 32
Nov 11 00:14:47 user nova-compute[75279]: node.session.nr_sessions = 1
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.authmethod = CHAP
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.username = RxdpNnVS
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.password = ***
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.username_in = <empty>
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.password_in = <empty>
Nov 11 00:14:47 user nova-compute[75279]: node.session.auth.chap_algs = MD5
Nov 11 00:14:47 user nova-compute[75279]: node.session.timeo.replacement_timeout = 120
Nov 11 00:14:47 user nova-compute[75279]: node.session.err_timeo.abort_timeout = 15
Nov 11 00:14:47 user nova-compute[75279]: node.session.err_timeo.lu_reset_timeout = 30
Nov 11 00:14:47 user nova-compute[75279]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 11 00:14:47 user nova-compute[75279]: node.session.err_timeo.host_reset_timeout = 60
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.FastAbort = Yes
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.InitialR2T = No
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.ImmediateData = Yes
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.FirstBurstLength = 262144
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.MaxBurstLength = 16776192
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.DefaultTime2Retain = 0
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.DefaultTime2Wait = 2
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.MaxConnections = 1
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 11 00:14:47 user nova-compute[75279]: node.session.iscsi.ERL = 0
Nov 11 00:14:47 user nova-compute[75279]: node.session.scan = manual
Nov 11 00:14:47 user nova-compute[75279]: node.session.reopen_max = 0
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].address = 172.16.0.220
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].port = 3260
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].startup = manual
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].tcp.window_size = 524288
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].tcp.type_of_service = 0
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].timeo.logout_timeout = 15
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].timeo.login_timeout = 15
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].timeo.auth_timeout = 45
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].timeo.noop_out_interval = 5
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].timeo.noop_out_timeout = 5
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.HeaderDigest = None
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.DataDigest = None
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.IFMarker = No
Nov 11 00:14:47 user nova-compute[75279]: node.conn[0].iscsi.OFMarker = No
Nov 11 00:14:47 user nova-compute[75279]: # END RECORD
Nov 11 00:14:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79c783-c9d9-442d-b661-feb809f025d8]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29748aa5-b165-446b-901e-8327929c6417]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxdpNnVS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxdpNnVS" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c3c524-5677-4261-b3c5-c463dd49a0af]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxdpNnVS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de35df-c365-46fa-8cdc-8d064cd21883]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97f589-41da-40f3-9c6f-f1b3f22b37a5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:14:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:14:47 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:14:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] HCTL ('37', '0', '0', 0) found on session 31 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1512130-8cc6-45d3-974f-ed14549c2898]: (4, ('0 0 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Searching for a device in session 31 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23731396231636234', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731396231636234', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1921956890',display_name='tempest-ServerStableDeviceRescueTest-server-1921956890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1921956890',id=21,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMCeSGzxyiY7bAQlNe8WIu4ZeS7J65pyMy65mRNjc0eXBNtRVvwbnuPZ46CQ4/6sh5ZZdiM+sYWv5WsTe3rDouP/EYxmRWMsad7rVl3pQH72/Pbmnu8azcy2nS2q9Dc+A==',key_name='tempest-keypair-1517673478',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0d496f01e14cc385058072a738a75c',ramdisk_id='',reservation_id='r-4sliv25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-26625521',owner_user_name='tempest-ServerStableDeviceRescueTest-26625521-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555cd57cc4c44e7db8846b432dd35fe3',uuid=9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "vif_mac": "fa:16:3e:77:95:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converting VIF {"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "vif_mac": "fa:16:3e:77:95:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'pci_devices' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.objects.base [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Object Instance<9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:14:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:14:47 user nova-compute[75279]:   <uuid>9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</uuid>
Nov 11 00:14:47 user nova-compute[75279]:   <name>instance-00000015</name>
Nov 11 00:14:47 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:14:47 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:14:47 user nova-compute[75279]:   <metadata>
Nov 11 00:14:47 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:14:47 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1921956890</nova:name>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:14:47</nova:creationTime>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:14:47 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:14:47 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:owner>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:user uuid="555cd57cc4c44e7db8846b432dd35fe3">tempest-ServerStableDeviceRescueTest-26625521-project-member</nova:user>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:project uuid="ed0d496f01e14cc385058072a738a75c">tempest-ServerStableDeviceRescueTest-26625521</nova:project>
Nov 11 00:14:47 user nova-compute[75279]:       </nova:owner>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:14:47 user nova-compute[75279]:       <nova:ports>
Nov 11 00:14:47 user nova-compute[75279]:         <nova:port uuid="89ea421e-b556-4145-b66e-7a09854cfc60">
Nov 11 00:14:47 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:14:47 user nova-compute[75279]:         </nova:port>
Nov 11 00:14:47 user nova-compute[75279]:       </nova:ports>
Nov 11 00:14:47 user nova-compute[75279]:     </nova:instance>
Nov 11 00:14:47 user nova-compute[75279]:   </metadata>
Nov 11 00:14:47 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:14:47 user nova-compute[75279]:     <system>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="serial">9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</entry>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="uuid">9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d</entry>
Nov 11 00:14:47 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:14:47 user nova-compute[75279]:     </system>
Nov 11 00:14:47 user nova-compute[75279]:   </sysinfo>
Nov 11 00:14:47 user nova-compute[75279]:   <os>
Nov 11 00:14:47 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:14:47 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:14:47 user nova-compute[75279]:   </os>
Nov 11 00:14:47 user nova-compute[75279]:   <features>
Nov 11 00:14:47 user nova-compute[75279]:     <acpi/>
Nov 11 00:14:47 user nova-compute[75279]:     <apic/>
Nov 11 00:14:47 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:14:47 user nova-compute[75279]:   </features>
Nov 11 00:14:47 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:14:47 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:14:47 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:14:47 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:14:47 user nova-compute[75279]:   </clock>
Nov 11 00:14:47 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:14:47 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:14:47 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:14:47 user nova-compute[75279]:   </cpu>
Nov 11 00:14:47 user nova-compute[75279]:   <devices>
Nov 11 00:14:47 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:14:47 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:14:47 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk"/>
Nov 11 00:14:47 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:14:47 user nova-compute[75279]:     </disk>
Nov 11 00:14:47 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:14:47 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:14:47 user nova-compute[75279]:       <source dev="/dev/sdf"/>
Nov 11 00:14:47 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:14:47 user nova-compute[75279]:       <serial>a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e</serial>
Nov 11 00:14:47 user nova-compute[75279]:     </disk>
Nov 11 00:14:47 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:14:47 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:14:47 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue"/>
Nov 11 00:14:47 user nova-compute[75279]:       <target dev="vdc" bus="virtio"/>
Nov 11 00:14:47 user nova-compute[75279]:       <boot order="1"/>
Nov 11 00:14:47 user nova-compute[75279]:     </disk>
Nov 11 00:14:47 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:14:47 user nova-compute[75279]:       <mac address="fa:16:3e:77:95:e8"/>
Nov 11 00:14:47 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:14:47 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:14:47 user nova-compute[75279]:       <target dev="tap89ea421e-b5"/>
Nov 11 00:14:47 user nova-compute[75279]:     </interface>
Nov 11 00:14:47 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:14:47 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/console.log" append="off"/>
Nov 11 00:14:47 user nova-compute[75279]:     </serial>
Nov 11 00:14:47 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:14:47 user nova-compute[75279]:     <video>
Nov 11 00:14:47 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:14:47 user nova-compute[75279]:     </video>
Nov 11 00:14:47 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:14:47 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:14:47 user nova-compute[75279]:     </rng>
Nov 11 00:14:47 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:14:47 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:14:47 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:14:47 user nova-compute[75279]:     </memballoon>
Nov 11 00:14:47 user nova-compute[75279]:   </devices>
Nov 11 00:14:47 user nova-compute[75279]: </domain>
Nov 11 00:14:47 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:14:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance destroyed successfully.
Nov 11 00:14:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] No VIF found with MAC fa:16:3e:77:95:e8, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:49 user nova-compute[75279]: WARNING nova.compute.manager [req-b9b4435c-e20c-41de-8bb2-384b3d95cc62 req-343f1c6a-7939-401d-8c58-6c33962e1841 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state rescuing.
Nov 11 00:14:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:14:51 user nova-compute[75279]: INFO nova.compute.claims [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Claim successful on node user
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:51 user nova-compute[75279]: WARNING nova.compute.manager [req-2d7cfc55-cb46-42cd-9031-9e609533f633 req-6f98803a-6cc0-4cc3-8176-ae8f956c2cf1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state rescuing.
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:14:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:14:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:14:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.policy [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223cf2dd1ecd4a12a5db181391692422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5707b16ebb6042e08f11590de3c92bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fdd2b1c-89e0-4ff3-8f8d-2bffce052743 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:14:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Creating image(s)
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "/opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk 1073741824" returned: 0 in 0.070s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Successfully created port: eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Cannot resize image /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Ensure instance console log exists: /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Successfully updated port: eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-changed-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Refreshing instance network info cache due to event network-changed-eaa007bd-acf7-45e7-b9c8-b70989f8370a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] Acquiring lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updating instance_info_cache with network_info: [{"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Instance network_info: |[{"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] Acquired lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Refreshing network info cache for port eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Start _get_guest_xml network_info=[{"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:14:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274183713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274183713',id=27,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-dttuzvqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:14:52Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a84bf4af-a07f-4509-9d66-9d5131febfc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid a84bf4af-a07f-4509-9d66-9d5131febfc5 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:14:54 user nova-compute[75279]:   <uuid>a84bf4af-a07f-4509-9d66-9d5131febfc5</uuid>
Nov 11 00:14:54 user nova-compute[75279]:   <name>instance-0000001b</name>
Nov 11 00:14:54 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:14:54 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:14:54 user nova-compute[75279]:   <metadata>
Nov 11 00:14:54 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:14:54 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-274183713</nova:name>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:14:54</nova:creationTime>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:14:54 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:14:54 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:owner>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:14:54 user nova-compute[75279]:       </nova:owner>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:14:54 user nova-compute[75279]:       <nova:ports>
Nov 11 00:14:54 user nova-compute[75279]:         <nova:port uuid="eaa007bd-acf7-45e7-b9c8-b70989f8370a">
Nov 11 00:14:54 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 11 00:14:54 user nova-compute[75279]:         </nova:port>
Nov 11 00:14:54 user nova-compute[75279]:       </nova:ports>
Nov 11 00:14:54 user nova-compute[75279]:     </nova:instance>
Nov 11 00:14:54 user nova-compute[75279]:   </metadata>
Nov 11 00:14:54 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:14:54 user nova-compute[75279]:     <system>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="serial">a84bf4af-a07f-4509-9d66-9d5131febfc5</entry>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="uuid">a84bf4af-a07f-4509-9d66-9d5131febfc5</entry>
Nov 11 00:14:54 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:14:54 user nova-compute[75279]:     </system>
Nov 11 00:14:54 user nova-compute[75279]:   </sysinfo>
Nov 11 00:14:54 user nova-compute[75279]:   <os>
Nov 11 00:14:54 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:14:54 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:14:54 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:14:54 user nova-compute[75279]:   </os>
Nov 11 00:14:54 user nova-compute[75279]:   <features>
Nov 11 00:14:54 user nova-compute[75279]:     <acpi/>
Nov 11 00:14:54 user nova-compute[75279]:     <apic/>
Nov 11 00:14:54 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:14:54 user nova-compute[75279]:   </features>
Nov 11 00:14:54 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:14:54 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:14:54 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:14:54 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:14:54 user nova-compute[75279]:   </clock>
Nov 11 00:14:54 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:14:54 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:14:54 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:14:54 user nova-compute[75279]:   </cpu>
Nov 11 00:14:54 user nova-compute[75279]:   <devices>
Nov 11 00:14:54 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:14:54 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:14:54 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk"/>
Nov 11 00:14:54 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:14:54 user nova-compute[75279]:     </disk>
Nov 11 00:14:54 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:14:54 user nova-compute[75279]:       <mac address="fa:16:3e:55:db:01"/>
Nov 11 00:14:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:14:54 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:14:54 user nova-compute[75279]:       <target dev="tapeaa007bd-ac"/>
Nov 11 00:14:54 user nova-compute[75279]:     </interface>
Nov 11 00:14:54 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:14:54 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/console.log" append="off"/>
Nov 11 00:14:54 user nova-compute[75279]:     </serial>
Nov 11 00:14:54 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:14:54 user nova-compute[75279]:     <video>
Nov 11 00:14:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:14:54 user nova-compute[75279]:     </video>
Nov 11 00:14:54 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:14:54 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:14:54 user nova-compute[75279]:     </rng>
Nov 11 00:14:54 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:14:54 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:14:54 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:14:54 user nova-compute[75279]:     </memballoon>
Nov 11 00:14:54 user nova-compute[75279]:   </devices>
Nov 11 00:14:54 user nova-compute[75279]: </domain>
Nov 11 00:14:54 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274183713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274183713',id=27,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-dttuzvqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:14:52Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a84bf4af-a07f-4509-9d66-9d5131febfc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG os_vif [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7df67f08-6b7c-571d-ad95-bd15b81c2652', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaa007bd-ac, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaa007bd-ac, col_values=(('qos', UUID('00f62739-4e93-42a6-88c7-a886ef732b96')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaa007bd-ac, col_values=(('external_ids', {'iface-id': 'eaa007bd-acf7-45e7-b9c8-b70989f8370a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:db:01', 'vm-uuid': 'a84bf4af-a07f-4509-9d66-9d5131febfc5'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:14:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:54 user nova-compute[75279]: INFO os_vif [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac')
Nov 11 00:14:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:14:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:55:db:01, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:14:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updated VIF entry in instance network info cache for port eaa007bd-acf7-45e7-b9c8-b70989f8370a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:14:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updating instance_info_cache with network_info: [{"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:14:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-04cdce03-f091-4619-afb2-38d9bba91cda req-b80e5562-bdec-46ba-b26c-bf2af4d7c37c service nova] Releasing lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] No waiting events found dispatching network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:56 user nova-compute[75279]: WARNING nova.compute.manager [req-fff2595b-8859-45d5-bd56-0412364e4c4e req-819217ae-ec25-47e0-8f6e-2e1abb0451db service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received unexpected event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a for instance with vm_state building and task_state spawning.
Nov 11 00:14:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:14:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:14:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:14:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:14:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] No waiting events found dispatching network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:14:58 user nova-compute[75279]: WARNING nova.compute.manager [req-a61c9734-4d01-48bc-8446-d4f5c0dc6d69 req-c449f656-90e6-4367-aea9-0c2769a5ea47 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received unexpected event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a for instance with vm_state building and task_state spawning.
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:14:59 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Instance spawned successfully.
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:14:59 user nova-compute[75279]: INFO nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 11 00:14:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:14:59 user nova-compute[75279]: INFO nova.compute.manager [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Took 8.07 seconds to build instance.
Nov 11 00:14:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d096acf9-e6e7-4f10-b08c-7ad449a754ae tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.208s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:14:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing instance network info cache due to event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:00 user nova-compute[75279]: INFO nova.compute.manager [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Detaching volume e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:15:00 user nova-compute[75279]: INFO nova.virt.block_device [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Attempting to driver detach volume e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c from mountpoint /dev/vdb
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Attempting to detach device vdb from instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:15:00 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:15:00 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:15:00 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:15:00 user nova-compute[75279]:   <serial>e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c</serial>
Nov 11 00:15:00 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:15:00 user nova-compute[75279]: </disk>
Nov 11 00:15:00 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:15:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully detached device vdb from instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b from the persistent domain config.
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:15:00 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:15:00 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:15:00 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:15:00 user nova-compute[75279]:   <serial>e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c</serial>
Nov 11 00:15:00 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:15:00 user nova-compute[75279]: </disk>
Nov 11 00:15:00 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updated VIF entry in instance network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b3b11e-93c0-494d-8e14-7986a50c0040 req-49890071-e2f3-4b25-9ad6-c90ee8234e11 service nova] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-changed-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Refreshing instance network info cache due to event network-changed-58a1a8e8-041e-4e12-8540-0fcfa0837a4f. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] Acquiring lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] Acquired lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Refreshing network info cache for port 58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updated VIF entry in instance network info cache for port 58a1a8e8-041e-4e12-8540-0fcfa0837a4f. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating instance_info_cache with network_info: [{"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing instance network info cache due to event network-changed-d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] Acquiring lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] Acquired lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Refreshing network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-07b4b011-046e-4c9e-856c-2a280b44e84c req-3c1f622c-5294-47f4-a496-8f6d72c0a3a5 service nova] Releasing lock "refresh_cache-e685210c-addc-45e1-a665-ab603c5f3340" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updated VIF entry in instance network info cache for port d2b67918-8939-4890-ba8f-0001db5ba09b. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [{"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c065d933-6b02-426f-92d1-f734d4d4f80f req-d09097aa-66cb-4681-93fd-669864d92082 service nova] Releasing lock "refresh_cache-e3ca7730-9c3a-430e-83bd-500aac5a7d7b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:02 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae is timed out.
Nov 11 00:15:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully detached device vdb from instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae from the live domain config.
Nov 11 00:15:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbUCwyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:02 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff03ab-4461-46fe-b3b0-377145bb1c34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:15:02 user nova-compute[75279]: No targets found.
Nov 11 00:15:02 user nova-compute[75279]: iSNS:
Nov 11 00:15:02 user nova-compute[75279]: No targets found.
Nov 11 00:15:02 user nova-compute[75279]: STATIC:
Nov 11 00:15:02 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:15:02 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:02 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:02 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:15:02 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:02 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:02 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:15:02 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:02 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:02 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db
Nov 11 00:15:02 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:02 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:02 user nova-compute[75279]: FIRMWARE:
Nov 11 00:15:02 user nova-compute[75279]: No targets found.
Nov 11 00:15:02 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:15:02 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:15:02 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec81b12-582f-4bf1-9f99-2f1571d0bcb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bbe5cb-dfbc-4c50-a3de-19945abf915a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:03 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db (non-flash)
Nov 11 00:15:03 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:03 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f720028f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ab54e-a50b-49d8-86ae-00d8f5d2d651]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde41250-994f-4183-bb40-6856a858449b]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0cc80b-4fd6-42fd-a712-bd5b90f8f47b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5cf16-4ff9-421f-907c-90ccb34acd15]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[295acac4-b4ce-4d7c-a757-30583b181df7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a16c3-8c05-49b9-bcc9-48e6ca48202f]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260]
Nov 11 00:15:03 user nova-compute[75279]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db, portal: 172.16.0.220,3260] successful.
Nov 11 00:15:03 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61d495-4fd2-4ded-bae0-ae6e1a035517]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== disconnect_volume: return (359ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:15:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Port 71c32096-1127-4b3b-b506-b52ae75f2951 binding to destination host user is already ACTIVE {{(pid=75279) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'flavor' on Instance uuid 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e6a7737-aec9-423c-a563-cc7c515de314 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.287s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 28.135s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:10 user nova-compute[75279]: INFO nova.compute.manager [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Terminating instance
Nov 11 00:15:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-d758534c-2e94-4edc-b404-2c5bce82c2f5 req-7219a974-ad12-4cf1-9a8d-1a991504535f service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Instance destroyed successfully.
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lazy-loading 'resources' on Instance uuid 07457a5e-5ed9-4d25-8218-aabe1c4689ae {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1739322803',display_name='tempest-VolumesSnapshotTestJSON-instance-1739322803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1739322803',id=23,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpAZan/ac5iVv5iImLhpYf36xof/1VOdfIzksKKSurpCsfrSD8ig4gIIN90mUxFXfrPWRwh3CGuab9HdcndKkhoAUPzoI8rzgUNjN+o0B0+gQhQx6oIZHemtJ7RWIPDKg==',key_name='tempest-keypair-2065316520',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ece3759ebf543dc8614b4ed2dd57763',ramdisk_id='',reservation_id='r-f0yw524s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-567109824',owner_user_name='tempest-VolumesSnapshotTestJSON-567109824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba76aa79464c4b0d8f8866630b07e332',uuid=07457a5e-5ed9-4d25-8218-aabe1c4689ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converting VIF {"id": "e4899405-99b5-4dea-a45f-6a7a37a89588", "address": "fa:16:3e:2d:4d:d4", "network": {"id": "b3f6c828-7a8c-4393-a732-3d1316387fc6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1685867725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ece3759ebf543dc8614b4ed2dd57763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4899405-99", "ovs_interfaceid": "e4899405-99b5-4dea-a45f-6a7a37a89588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_vif [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4899405-99, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cef527b-9352-4233-994d-5be7e8927f0b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:11 user nova-compute[75279]: INFO os_vif [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:4d:d4,bridge_name='br-int',has_traffic_filtering=True,id=e4899405-99b5-4dea-a45f-6a7a37a89588,network=Network(b3f6c828-7a8c-4393-a732-3d1316387fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4899405-99')
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbUCwyxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:11 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8fcd1a-c2a2-43b2-9f69-670770bbaa98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:15:11 user nova-compute[75279]: No targets found.
Nov 11 00:15:11 user nova-compute[75279]: iSNS:
Nov 11 00:15:11 user nova-compute[75279]: No targets found.
Nov 11 00:15:11 user nova-compute[75279]: STATIC:
Nov 11 00:15:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:15:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:15:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:11 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:15:11 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:11 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:11 user nova-compute[75279]: FIRMWARE:
Nov 11 00:15:11 user nova-compute[75279]: No targets found.
Nov 11 00:15:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:15:11 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:15:11 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58293abc-c375-4c99-b4a2-61d4976913db', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef9d36-357e-4b8a-bce0-2a92c6b71a8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc2bf0f-5300-414a-b5f0-8dd720be0e23]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:11 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:11 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:11 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:11 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f72000bc820>, {}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Disconnecting from: [] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.167s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] <== disconnect_volume: return (168ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:15:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Deleting instance files /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae_del
Nov 11 00:15:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Deletion of /opt/stack/data/nova/instances/07457a5e-5ed9-4d25-8218-aabe1c4689ae_del complete
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.utils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dfdb9d-2f3b-45e6-ad7c-ad4a394af3fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: INFO nova.compute.manager [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c627d009-686a-4be8-971e-861cd4f190ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb1be9-224c-41ca-a304-cded008979e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4054bd05-7b22-44c1-a7f3-3f136964afa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:15:11 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:15:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf58790-80a3-4cb2-816c-4686b10ea6e7]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:15:11 user nova-compute[75279]: DEBUG os_brick.utils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:12 user nova-compute[75279]: WARNING nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state active and task_state deleting.
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:12 user nova-compute[75279]: WARNING nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state active and task_state deleting.
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:12 user nova-compute[75279]: WARNING nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state active and task_state deleting.
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-unplugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Acquiring lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] No waiting events found dispatching network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:12 user nova-compute[75279]: WARNING nova.compute.manager [req-bb8d491a-5100-4b60-a2f8-9b059ac3196a req-33f6ad05-94c8-4205-ac80-72556b7c0b5d service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received unexpected event network-vif-plugged-e4899405-99b5-4dea-a45f-6a7a37a89588 for instance with vm_state active and task_state deleting.
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:12 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Took 1.39 seconds to deallocate network for instance.
Nov 11 00:15:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-f42c05fd-d709-4d8d-8664-e5b4a7cc8cf9 req-c12af31d-5344-4ee4-9e04-9b1e16fa1501 service nova] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Received event network-vif-deleted-e4899405-99b5-4dea-a45f-6a7a37a89588 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:13 user nova-compute[75279]: WARNING nova.volume.cinder [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Attachment 952041ea-8d2f-4f48-86ea-7795ccd97779 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 952041ea-8d2f-4f48-86ea-7795ccd97779. (HTTP 404) (Request-ID: req-4d899552-b579-463a-ba27-9815eedcecf9)
Nov 11 00:15:13 user nova-compute[75279]: INFO nova.compute.manager [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] [instance: 07457a5e-5ed9-4d25-8218-aabe1c4689ae] Took 0.31 seconds to detach 1 volumes for instance.
Nov 11 00:15:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.volume.cinder [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Update attachment failed for attachment 421f1399-d35c-423c-8c75-fb08b1b163c5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Failed to attach 155d19ec-8b72-4a0e-94b8-d4d90ce5bf09 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Traceback (most recent call last):
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     ret_val = method(obj, context, *args, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     self._do_attach(context, instance, volume, volume_api,
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     self._volume_attach(context, volume, connector, instance,
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     connection_info = volume_api.attachment_update(
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     res = method(self, ctx, *args, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     with excutils.save_and_reraise_exception():
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     self.force_reraise()
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     raise self.value
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     return method.func(obj, *args, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     resp = self._update('/attachments/%s' % id, body)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     return self.request(url, method, **kwargs)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d]     raise exceptions.from_response(resp, body)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2)
Nov 11 00:15:13 user nova-compute[75279]: ERROR nova.compute.manager [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] 
Nov 11 00:15:13 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:15:13 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:15:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.479s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server [None req-741d67fb-229f-41ec-af12-d6c164b92d34 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f8d06138-0192-4a06-8aa6-f044f88325d2)
Nov 11 00:15:14 user nova-compute[75279]: ERROR oslo_messaging.rpc.server 
Nov 11 00:15:14 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Deleted allocations for instance 07457a5e-5ed9-4d25-8218-aabe1c4689ae
Nov 11 00:15:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-82dddb0c-41d3-4bb8-a48f-dc065cac58d1 tempest-VolumesSnapshotTestJSON-567109824 tempest-VolumesSnapshotTestJSON-567109824-project-member] Lock "07457a5e-5ed9-4d25-8218-aabe1c4689ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.023s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:15 user nova-compute[75279]: INFO nova.compute.manager [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Attaching volume 02817abf-4396-4042-a0ea-4c53cf208c6b to /dev/vdb
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[77438fcc-d5f5-4e94-ac16-41947a856089]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6fbbd4-9a55-488e-b616-9fb4e0f042eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56c505-4f8b-43ca-946d-6b8bf40a5574]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c281da0-c821-4cda-9b1b-fea83c2fa42d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:15:15 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:15:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b2495-d939-4b72-ad5a-3a0baf0e9694]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG os_brick.utils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:15 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating existing volume attachment record: 48a79a8c-2902-4dd1-b2fc-c4a6308d44a7 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:15:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:21 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b is timed out.
Nov 11 00:15:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully detached device vdb from instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b from the live domain config.
Nov 11 00:15:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwKksNJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:21 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[270b4e46-12b1-4582-85e4-cbc9a487c585]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:15:21 user nova-compute[75279]: No targets found.
Nov 11 00:15:21 user nova-compute[75279]: iSNS:
Nov 11 00:15:21 user nova-compute[75279]: No targets found.
Nov 11 00:15:21 user nova-compute[75279]: STATIC:
Nov 11 00:15:21 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:15:21 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:21 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:21 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c
Nov 11 00:15:21 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:21 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:21 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:15:21 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:15:21 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:15:21 user nova-compute[75279]: FIRMWARE:
Nov 11 00:15:21 user nova-compute[75279]: No targets found.
Nov 11 00:15:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:15:21 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:15:21 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[422779c2-7918-4408-88ce-19e052ea3c51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528865d-b138-4e40-8cdc-3cd56739dcbd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:21 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:21 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:21 user nova-compute[75279]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c (non-flash)
Nov 11 00:15:21 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f8316cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925e7b5-d016-4e4a-ae94-fff6fc2d62b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf56d4f-eb0b-4764-bd07-0eca9a1e9192]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dceb30-9f6b-4ae5-9dd2-9d7be9fc5371]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa80fc6-d9be-4211-8b92-4cc6ccc58bc2]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b208ef0-3b52-4465-8cd1-f157771f881e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4448837-703d-418c-b095-f073c0931f2f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260]
Nov 11 00:15:21 user nova-compute[75279]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c, portal: 172.16.0.220,3260] successful.
Nov 11 00:15:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93e7c21-6f75-4fa5-bbf4-8f3fe4240c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d8d4d6-9f18-42e8-b574-c33fb49ea0ab]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] <== disconnect_volume: return (344ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:15:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:22 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'flavor' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a83b6ba8-b3d9-4205-9fbe-e771d27a53c4 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.256s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:26 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:15:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:30 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:15:32 user nova-compute[75279]: INFO nova.compute.claims [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Claim successful on node user
Nov 11 00:15:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:15:32 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.policy [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93f7498f8558443eab6afb03331bc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae778b46b71f4d1db8fce5694256ebb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:15:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:15:32 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Creating image(s)
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.267s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk 1073741824" returned: 0 in 0.059s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Successfully created port: 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Cannot resize image /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Ensure instance console log exists: /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Successfully updated port: 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing instance network info cache due to event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance network_info: |[{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start _get_guest_xml network_info=[{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:15:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:15:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJya/fopfTx2ZNMXgYZa1Aku8JCVN6HDwl1pMUB72CTdXAc/d983LmliDjZTafT4ZK9lrI+RLAaIA6PbRgZhJGQ+ndYx1WdF/Ey7SMLBvxoLXwXYmP0q24+Bsl5MiRPCqw==',key_name='tempest-keypair-58678597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_devices' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:15:35 user nova-compute[75279]:   <uuid>c2c05958-0016-4d89-9d1a-0c593b761ab1</uuid>
Nov 11 00:15:35 user nova-compute[75279]:   <name>instance-0000001c</name>
Nov 11 00:15:35 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:15:35 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:15:35 user nova-compute[75279]:   <metadata>
Nov 11 00:15:35 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:15:35 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2127045035</nova:name>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:15:35</nova:creationTime>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:15:35 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:15:35 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:owner>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:user uuid="93f7498f8558443eab6afb03331bc6aa">tempest-AttachVolumeShelveTestJSON-174044347-project-member</nova:user>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:project uuid="ae778b46b71f4d1db8fce5694256ebb9">tempest-AttachVolumeShelveTestJSON-174044347</nova:project>
Nov 11 00:15:35 user nova-compute[75279]:       </nova:owner>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:15:35 user nova-compute[75279]:       <nova:ports>
Nov 11 00:15:35 user nova-compute[75279]:         <nova:port uuid="1a9abbe9-245a-4d04-8126-92f12a5b6125">
Nov 11 00:15:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:15:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:15:35 user nova-compute[75279]:       </nova:ports>
Nov 11 00:15:35 user nova-compute[75279]:     </nova:instance>
Nov 11 00:15:35 user nova-compute[75279]:   </metadata>
Nov 11 00:15:35 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:15:35 user nova-compute[75279]:     <system>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="serial">c2c05958-0016-4d89-9d1a-0c593b761ab1</entry>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="uuid">c2c05958-0016-4d89-9d1a-0c593b761ab1</entry>
Nov 11 00:15:35 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:15:35 user nova-compute[75279]:     </system>
Nov 11 00:15:35 user nova-compute[75279]:   </sysinfo>
Nov 11 00:15:35 user nova-compute[75279]:   <os>
Nov 11 00:15:35 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:15:35 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:15:35 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:15:35 user nova-compute[75279]:   </os>
Nov 11 00:15:35 user nova-compute[75279]:   <features>
Nov 11 00:15:35 user nova-compute[75279]:     <acpi/>
Nov 11 00:15:35 user nova-compute[75279]:     <apic/>
Nov 11 00:15:35 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:15:35 user nova-compute[75279]:   </features>
Nov 11 00:15:35 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:15:35 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:15:35 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:15:35 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:15:35 user nova-compute[75279]:   </clock>
Nov 11 00:15:35 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:15:35 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:15:35 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:15:35 user nova-compute[75279]:   </cpu>
Nov 11 00:15:35 user nova-compute[75279]:   <devices>
Nov 11 00:15:35 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:15:35 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:15:35 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk"/>
Nov 11 00:15:35 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:15:35 user nova-compute[75279]:     </disk>
Nov 11 00:15:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:15:35 user nova-compute[75279]:       <mac address="fa:16:3e:99:66:2a"/>
Nov 11 00:15:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:15:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:15:35 user nova-compute[75279]:       <target dev="tap1a9abbe9-24"/>
Nov 11 00:15:35 user nova-compute[75279]:     </interface>
Nov 11 00:15:35 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:15:35 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/console.log" append="off"/>
Nov 11 00:15:35 user nova-compute[75279]:     </serial>
Nov 11 00:15:35 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:15:35 user nova-compute[75279]:     <video>
Nov 11 00:15:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:15:35 user nova-compute[75279]:     </video>
Nov 11 00:15:35 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:15:35 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:15:35 user nova-compute[75279]:     </rng>
Nov 11 00:15:35 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:15:35 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:15:35 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:15:35 user nova-compute[75279]:     </memballoon>
Nov 11 00:15:35 user nova-compute[75279]:   </devices>
Nov 11 00:15:35 user nova-compute[75279]: </domain>
Nov 11 00:15:35 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJya/fopfTx2ZNMXgYZa1Aku8JCVN6HDwl1pMUB72CTdXAc/d983LmliDjZTafT4ZK9lrI+RLAaIA6PbRgZhJGQ+ndYx1WdF/Ey7SMLBvxoLXwXYmP0q24+Bsl5MiRPCqw==',key_name='tempest-keypair-58678597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG os_vif [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ec6d90d-e921-50f1-acd4-43880aebf70b', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9abbe9-24, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a9abbe9-24, col_values=(('qos', UUID('748838f6-b057-4e40-8f02-2984c365bc5f')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a9abbe9-24, col_values=(('external_ids', {'iface-id': '1a9abbe9-245a-4d04-8126-92f12a5b6125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:66:2a', 'vm-uuid': 'c2c05958-0016-4d89-9d1a-0c593b761ab1'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:35 user nova-compute[75279]: INFO os_vif [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24')
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No VIF found with MAC fa:16:3e:99:66:2a, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updated VIF entry in instance network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0065ea5b-f0e9-4a05-b137-609a85d6f37a req-5e768f62-4afd-4965-a39e-f6a3489c7b1e service nova] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:37 user nova-compute[75279]: WARNING nova.compute.manager [req-314426f1-439a-4709-b403-87571cc7adc1 req-5990e06b-9e8b-40ce-83e0-3b490e2bab1a service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state building and task_state spawning.
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:15:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:39 user nova-compute[75279]: WARNING nova.compute.manager [req-c3effb76-87cb-41be-a813-7021b0c3dacc req-fc3ec560-8fad-4d2e-ba25-5b1b4eea063f service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state building and task_state spawning.
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:15:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:15:39 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.05691909790039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:39 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance spawned successfully.
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:15:39 user nova-compute[75279]: INFO nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 as it has an incoming, in-progress migration b8f8b380-62e1-4633-af9b-a77738d1c507. Migration status is post-migrating {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:15:39 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating resource usage from migration b8f8b380-62e1-4633-af9b-a77738d1c507
Nov 11 00:15:39 user nova-compute[75279]: INFO nova.compute.manager [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Took 7.51 seconds to build instance.
Nov 11 00:15:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8a4d62f-6d71-4175-81e2-bf639869058c tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.637s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e685210c-addc-45e1-a665-ab603c5f3340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration b8f8b380-62e1-4633-af9b-a77738d1c507 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:15:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.753s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:15:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuEGPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:15:44 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:15:44 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:15:44 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ae5e7-b2c3-4dda-9b1b-02e5dfdee689]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:15:44 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ab861-5332-43fd-b378-e63046fa6401]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b] added
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[53724bb0-6010-42c2-988b-f2c0fc835701]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d826b45a-e2e9-438d-9c99-6cac55b56107]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDuEGPvN {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDuEGPvN" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc31e3-68c1-4971-97b8-6cfe8f531507]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDuEGPvN'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b0bb62-a009-46ed-8777-480b6f32d54d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[600dfa78-756b-43c9-b357-6210fa2cc17e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f174b0-7a51-48fe-a8d5-3bf81be7d51d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260]
Nov 11 00:15:44 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260] successful.
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45af365-ed32-418e-b3a6-1854b060209d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe87e3-9078-468b-8da0-e95d3340d5cb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:15:44 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:15:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a3266-caa3-46f1-940e-689314778cb5]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:15:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuEGPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23062353864356231', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062353864356231', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:15:45 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:15:45 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:15:45 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:15:45 user nova-compute[75279]:   <serial>02817abf-4396-4042-a0ea-4c53cf208c6b</serial>
Nov 11 00:15:45 user nova-compute[75279]: </disk>
Nov 11 00:15:45 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:15:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:15:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:15:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:14:e6:7c, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:15:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-64bc29ca-c2c3-495e-ab7e-0aa64ca8e457 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.165s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:47 user nova-compute[75279]: INFO nova.compute.manager [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Detaching volume 02817abf-4396-4042-a0ea-4c53cf208c6b
Nov 11 00:15:47 user nova-compute[75279]: INFO nova.virt.block_device [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Attempting to driver detach volume 02817abf-4396-4042-a0ea-4c53cf208c6b from mountpoint /dev/vdb
Nov 11 00:15:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Attempting to detach device vdb from instance e685210c-addc-45e1-a665-ab603c5f3340 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:15:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:15:47 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:15:47 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:15:47 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:15:47 user nova-compute[75279]:   <serial>02817abf-4396-4042-a0ea-4c53cf208c6b</serial>
Nov 11 00:15:47 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:15:47 user nova-compute[75279]: </disk>
Nov 11 00:15:47 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:15:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance e685210c-addc-45e1-a665-ab603c5f3340 from the persistent domain config.
Nov 11 00:15:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e685210c-addc-45e1-a665-ab603c5f3340 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:15:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:15:47 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:15:47 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:15:47 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:15:47 user nova-compute[75279]:   <serial>02817abf-4396-4042-a0ea-4c53cf208c6b</serial>
Nov 11 00:15:47 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:15:47 user nova-compute[75279]: </disk>
Nov 11 00:15:47 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:15:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:50 user nova-compute[75279]: INFO nova.compute.manager [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Terminating instance
Nov 11 00:15:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-de51f3b3-af4a-4b64-97e2-817a3ca3cd80 req-dc1069a9-c878-438d-a16e-b2cff472d2e8 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Instance destroyed successfully.
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid e3ca7730-9c3a-430e-83bd-500aac5a7d7b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1121013036',display_name='tempest-ServerRescueNegativeTestJSON-server-1121013036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1121013036',id=19,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtSClAvXtKr6JVW5NihJfFVYFdhstg4smHU7qUBqjmt2NH5LJuvPb2M70olryln7+NEi/su0iyugOlAg03uS7EgMms9+UuREHZ4+KEqGcR0pFYtRctX9lbsVyzFeM74HA==',key_name='tempest-keypair-1990191476',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:11:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-703kr6uy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=e3ca7730-9c3a-430e-83bd-500aac5a7d7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "d2b67918-8939-4890-ba8f-0001db5ba09b", "address": "fa:16:3e:c6:03:ab", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b67918-89", "ovs_interfaceid": "d2b67918-8939-4890-ba8f-0001db5ba09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG os_vif [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2b67918-89, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc0280e1-95ef-4dc5-9403-9cd3f60534b6) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:51 user nova-compute[75279]: INFO os_vif [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:03:ab,bridge_name='br-int',has_traffic_filtering=True,id=d2b67918-8939-4890-ba8f-0001db5ba09b,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b67918-89')
Nov 11 00:15:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Deleting instance files /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b_del
Nov 11 00:15:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Deletion of /opt/stack/data/nova/instances/e3ca7730-9c3a-430e-83bd-500aac5a7d7b_del complete
Nov 11 00:15:51 user nova-compute[75279]: INFO nova.compute.manager [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 11 00:15:51 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:15:51 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:15:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:53 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Took 1.37 seconds to deallocate network for instance.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-3aa6d46b-c419-467e-bd6b-dda7c8d2255e req-122ddfe3-e5e8-4e21-a881-d13ac9ade515 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-deleted-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: INFO nova.compute.manager [req-3aa6d46b-c419-467e-bd6b-dda7c8d2255e req-122ddfe3-e5e8-4e21-a881-d13ac9ade515 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Neutron deleted interface d2b67918-8939-4890-ba8f-0001db5ba09b; detaching it from the instance and deleting it from the info cache
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-3aa6d46b-c419-467e-bd6b-dda7c8d2255e req-122ddfe3-e5e8-4e21-a881-d13ac9ade515 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-3aa6d46b-c419-467e-bd6b-dda7c8d2255e req-122ddfe3-e5e8-4e21-a881-d13ac9ade515 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Detach interface failed, port_id=d2b67918-8939-4890-ba8f-0001db5ba09b, reason: Instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:53 user nova-compute[75279]: WARNING nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state deleted and task_state None.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:53 user nova-compute[75279]: WARNING nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state deleted and task_state None.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:53 user nova-compute[75279]: WARNING nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state deleted and task_state None.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:53 user nova-compute[75279]: WARNING nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-unplugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state deleted and task_state None.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Acquiring lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] No waiting events found dispatching network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:15:53 user nova-compute[75279]: WARNING nova.compute.manager [req-d4631ef9-ead1-46da-96b4-60b3899b3b5c req-7bce711e-9301-4b2e-8bf5-7ddc4a0a1553 service nova] [instance: e3ca7730-9c3a-430e-83bd-500aac5a7d7b] Received unexpected event network-vif-plugged-d2b67918-8939-4890-ba8f-0001db5ba09b for instance with vm_state deleted and task_state None.
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:15:53 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:15:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:54 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Deleted allocations for instance e3ca7730-9c3a-430e-83bd-500aac5a7d7b
Nov 11 00:15:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f03bb92a-53fe-43e2-a08b-cc4bb804e3b7 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "e3ca7730-9c3a-430e-83bd-500aac5a7d7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.247s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:15:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:15:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Starting finish_migration {{(pid=75279) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:16:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Creating image(s)
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Ensure instance console log exists: /opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start _get_guest_xml network_info=[{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c6e1b6b4-8688-4d28-b8e0-6828053720f1', 'attached_at': '2023-11-11T00:16:04.000000', 'detached_at': '', 'volume_id': 'cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'serial': 'cd475a1e-79de-4ff4-8efb-0b5c900998c8'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '60918366-4573-453b-8bbf-5c1f54a4b68a', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:16:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:16:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:16:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:16:04 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44c282-0d93-47a3-88b2-417dcc7da284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:16:04 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[579dca36-ed5c-466b-b1a3-65c8b3e1e808]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8] added
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6f2191-828e-4283-a092-99a5d0afab40]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52592084-cdc8-4b53-bd33-c77d6be9ac67]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxqZhPDC {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxqZhPDC" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c686da-3314-47b5-8cf5-8182b0883096]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mxqZhPDC'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c293bea0-e0eb-440e-a559-b57fbd48c2d6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3f651-58d0-4a97-a057-32b1af3d530d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aff2a5-74cb-4510-94ee-2227ac8704a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]
Nov 11 00:16:04 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d8e5c-1117-4dc5-85d1-1d8ff84fea41]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f05e9-1d6e-4ab0-ada5-cc3e0abf40df]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:04 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:16:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e908a6c1-a321-4b2e-9031-2169bab5e1b1]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:16:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23662316662636265', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662316662636265', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:13:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:16:05 user nova-compute[75279]:   <uuid>c6e1b6b4-8688-4d28-b8e0-6828053720f1</uuid>
Nov 11 00:16:05 user nova-compute[75279]:   <name>instance-00000019</name>
Nov 11 00:16:05 user nova-compute[75279]:   <memory>2097152</memory>
Nov 11 00:16:05 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:16:05 user nova-compute[75279]:   <metadata>
Nov 11 00:16:05 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:16:05 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:16:05 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherA-server-1762044897</nova:name>
Nov 11 00:16:05 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:16:04</nova:creationTime>
Nov 11 00:16:05 user nova-compute[75279]:       <nova:flavor name="m1.small">
Nov 11 00:16:05 user nova-compute[75279]:         <nova:memory>2048</nova:memory>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:disk>20</nova:disk>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:16:05 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:16:05 user nova-compute[75279]:       <nova:owner>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:user uuid="f5de431660e34578b7ef8b6b7e0577ab">tempest-ServerActionsTestOtherA-191498200-project-member</nova:user>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:project uuid="e56bb9030efe414aa52c4aa97febfd2e">tempest-ServerActionsTestOtherA-191498200</nova:project>
Nov 11 00:16:05 user nova-compute[75279]:       </nova:owner>
Nov 11 00:16:05 user nova-compute[75279]:       <nova:ports>
Nov 11 00:16:05 user nova-compute[75279]:         <nova:port uuid="71c32096-1127-4b3b-b506-b52ae75f2951">
Nov 11 00:16:05 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:16:05 user nova-compute[75279]:         </nova:port>
Nov 11 00:16:05 user nova-compute[75279]:       </nova:ports>
Nov 11 00:16:05 user nova-compute[75279]:     </nova:instance>
Nov 11 00:16:05 user nova-compute[75279]:   </metadata>
Nov 11 00:16:05 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:16:05 user nova-compute[75279]:     <system>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="serial">c6e1b6b4-8688-4d28-b8e0-6828053720f1</entry>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="uuid">c6e1b6b4-8688-4d28-b8e0-6828053720f1</entry>
Nov 11 00:16:05 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:16:05 user nova-compute[75279]:     </system>
Nov 11 00:16:05 user nova-compute[75279]:   </sysinfo>
Nov 11 00:16:05 user nova-compute[75279]:   <os>
Nov 11 00:16:05 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:16:05 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:16:05 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:16:05 user nova-compute[75279]:   </os>
Nov 11 00:16:05 user nova-compute[75279]:   <features>
Nov 11 00:16:05 user nova-compute[75279]:     <acpi/>
Nov 11 00:16:05 user nova-compute[75279]:     <apic/>
Nov 11 00:16:05 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:16:05 user nova-compute[75279]:   </features>
Nov 11 00:16:05 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:16:05 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:16:05 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:16:05 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:16:05 user nova-compute[75279]:   </clock>
Nov 11 00:16:05 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:16:05 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:16:05 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:16:05 user nova-compute[75279]:   </cpu>
Nov 11 00:16:05 user nova-compute[75279]:   <devices>
Nov 11 00:16:05 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:16:05 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:16:05 user nova-compute[75279]:       <source dev="/dev/sdd"/>
Nov 11 00:16:05 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:16:05 user nova-compute[75279]:       <serial>cd475a1e-79de-4ff4-8efb-0b5c900998c8</serial>
Nov 11 00:16:05 user nova-compute[75279]:     </disk>
Nov 11 00:16:05 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:16:05 user nova-compute[75279]:       <mac address="fa:16:3e:72:db:2e"/>
Nov 11 00:16:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:16:05 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:16:05 user nova-compute[75279]:       <target dev="tap71c32096-11"/>
Nov 11 00:16:05 user nova-compute[75279]:     </interface>
Nov 11 00:16:05 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:16:05 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1/console.log" append="off"/>
Nov 11 00:16:05 user nova-compute[75279]:     </serial>
Nov 11 00:16:05 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:16:05 user nova-compute[75279]:     <video>
Nov 11 00:16:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:16:05 user nova-compute[75279]:     </video>
Nov 11 00:16:05 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:16:05 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:16:05 user nova-compute[75279]:     </rng>
Nov 11 00:16:05 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:16:05 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:16:05 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:16:05 user nova-compute[75279]:     </memballoon>
Nov 11 00:16:05 user nova-compute[75279]:   </devices>
Nov 11 00:16:05 user nova-compute[75279]: </domain>
Nov 11 00:16:05 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:13:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-964247792-network", "vif_mac": "fa:16:3e:72:db:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG os_vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0019765-39ae-5cb4-b44f-45d66a8155cf', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71c32096-11, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71c32096-11, col_values=(('qos', UUID('eaeede8a-4c74-4379-83f8-ed1e1da9e663')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71c32096-11, col_values=(('external_ids', {'iface-id': '71c32096-1127-4b3b-b506-b52ae75f2951', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:db:2e', 'vm-uuid': 'c6e1b6b4-8688-4d28-b8e0-6828053720f1'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:05 user nova-compute[75279]: INFO os_vif [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11')
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:16:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] No VIF found with MAC fa:16:3e:72:db:2e, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:07 user nova-compute[75279]: WARNING nova.compute.manager [req-1f7f7b58-686a-4615-beaf-7cfdd286b4c5 req-ec480d46-70ff-4c91-bb2b-8d337a18fd82 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state active and task_state resize_finish.
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e685210c-addc-45e1-a665-ab603c5f3340 is timed out.
Nov 11 00:16:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance e685210c-addc-45e1-a665-ab603c5f3340 from the live domain config.
Nov 11 00:16:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuEGPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:16:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc5e68-cfa0-4a9b-9959-b7961cfd1813]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:16:08 user nova-compute[75279]: No targets found.
Nov 11 00:16:08 user nova-compute[75279]: iSNS:
Nov 11 00:16:08 user nova-compute[75279]: No targets found.
Nov 11 00:16:08 user nova-compute[75279]: STATIC:
Nov 11 00:16:08 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:16:08 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:16:08 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:16:08 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b
Nov 11 00:16:08 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:16:08 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:16:08 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:16:08 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:16:08 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:16:08 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:16:08 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:16:08 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:16:08 user nova-compute[75279]: FIRMWARE:
Nov 11 00:16:08 user nova-compute[75279]: No targets found.
Nov 11 00:16:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:16:08 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:16:08 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d7716-195e-4d57-978f-a23bf50a958c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb6b45-67a9-49d0-a055-8a2af5d9d80d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:16:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b (non-flash)
Nov 11 00:16:08 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:16:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e061f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc4e2dc-260e-46c6-8b76-2da3ecfa6e30]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e2a7d-e23a-413b-9b42-8d8c56e01491]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451e2e5-0f42-47fc-8c9a-82b841ff9cd1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff14dbe-9926-4333-a954-4e0abd8f9719]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d93d03-95be-42af-9066-f23d46623785]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff1fd1a-714a-4b66-869e-2e9d84bca28e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260]
Nov 11 00:16:08 user nova-compute[75279]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b, portal: 172.16.0.220,3260] successful.
Nov 11 00:16:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02817abf-4396-4042-a0ea-4c53cf208c6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8416e2-a1c7-495a-8274-1d662fb152a7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== disconnect_volume: return (364ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:16:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:09 user nova-compute[75279]: WARNING nova.compute.manager [req-6e62f6c5-5f01-4ef7-a1f0-44d902a4c657 req-c0114fd6-3ff0-43f8-8191-ca2b389a2c96 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state active and task_state resize_finish.
Nov 11 00:16:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:16:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance running successfully.
Nov 11 00:16:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Failed to set time: agent not configured {{(pid=75279) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 11 00:16:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-91c260cc-adc8-4e94-b8ef-788992009389 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] finish_migration finished successfully. {{(pid=75279) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 11 00:16:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:16:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-49a918d3-cabc-445b-972b-259a7523748d tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.401s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 9e720d48-0c0f-4fe6-b778-e5568e97eabf {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 600c2f85-9476-48eb-b37f-7e845469fc5d {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid c6e1b6b4-8688-4d28-b8e0-6828053720f1 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid a84bf4af-a07f-4509-9d66-9d5131febfc5 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:31 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:16:33 user nova-compute[75279]: INFO nova.compute.claims [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Claim successful on node user
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:16:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:16:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:16:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Creating image(s)
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "/opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "/opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.policy [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '882e3263349644018816651225b7c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0df13d96fd4216b0b59d82e1bdf05c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:16:34 user nova-compute[75279]: INFO nova.compute.manager [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Unrescuing
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.213s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk 1073741824" returned: 0 in 0.071s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'flavor' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Successfully created port: 4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:36 user nova-compute[75279]: WARNING nova.compute.manager [req-161f59da-e302-410e-8704-75aaffa22fe4 req-969dda94-721b-4e66-a9c7-2aef130ffbf2 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance destroyed successfully.
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Successfully updated port: 4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquired lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-changed-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Refreshing instance network info cache due to event network-changed-4eb70b58-b4c6-4954-8dcc-2ba921665429. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] Acquiring lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.network.neutron [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Updating instance_info_cache with network_info: [{"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Releasing lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Instance network_info: |[{"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] Acquired lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.network.neutron [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Refreshing network info cache for port 4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Start _get_guest_xml network_info=[{"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:16:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:16:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1903099657',display_name='tempest-VolumesNegativeTest-instance-1903099657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1903099657',id=29,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0df13d96fd4216b0b59d82e1bdf05c',ramdisk_id='',reservation_id='r-rmgz0g6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1516485250',owner_user_name='tempest-VolumesNegativeTest-1516485250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:16:35Z,user_data=None,user_id='882e3263349644018816651225b7c1c0',uuid=2bf12758-cc0d-47dc-8582-cfeadc9ea2f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converting VIF {"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:16:37 user nova-compute[75279]:   <uuid>2bf12758-cc0d-47dc-8582-cfeadc9ea2f0</uuid>
Nov 11 00:16:37 user nova-compute[75279]:   <name>instance-0000001d</name>
Nov 11 00:16:37 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:16:37 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:16:37 user nova-compute[75279]:   <metadata>
Nov 11 00:16:37 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:16:37 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:name>tempest-VolumesNegativeTest-instance-1903099657</nova:name>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:16:36</nova:creationTime>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:16:37 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:16:37 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:owner>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:user uuid="882e3263349644018816651225b7c1c0">tempest-VolumesNegativeTest-1516485250-project-member</nova:user>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:project uuid="1e0df13d96fd4216b0b59d82e1bdf05c">tempest-VolumesNegativeTest-1516485250</nova:project>
Nov 11 00:16:37 user nova-compute[75279]:       </nova:owner>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:16:37 user nova-compute[75279]:       <nova:ports>
Nov 11 00:16:37 user nova-compute[75279]:         <nova:port uuid="4eb70b58-b4c6-4954-8dcc-2ba921665429">
Nov 11 00:16:37 user nova-compute[75279]:           <nova:ip type="fixed" address="192.168.233.232" ipVersion="4"/>
Nov 11 00:16:37 user nova-compute[75279]:         </nova:port>
Nov 11 00:16:37 user nova-compute[75279]:       </nova:ports>
Nov 11 00:16:37 user nova-compute[75279]:     </nova:instance>
Nov 11 00:16:37 user nova-compute[75279]:   </metadata>
Nov 11 00:16:37 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:16:37 user nova-compute[75279]:     <system>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="serial">2bf12758-cc0d-47dc-8582-cfeadc9ea2f0</entry>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="uuid">2bf12758-cc0d-47dc-8582-cfeadc9ea2f0</entry>
Nov 11 00:16:37 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:16:37 user nova-compute[75279]:     </system>
Nov 11 00:16:37 user nova-compute[75279]:   </sysinfo>
Nov 11 00:16:37 user nova-compute[75279]:   <os>
Nov 11 00:16:37 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:16:37 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:16:37 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:16:37 user nova-compute[75279]:   </os>
Nov 11 00:16:37 user nova-compute[75279]:   <features>
Nov 11 00:16:37 user nova-compute[75279]:     <acpi/>
Nov 11 00:16:37 user nova-compute[75279]:     <apic/>
Nov 11 00:16:37 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:16:37 user nova-compute[75279]:   </features>
Nov 11 00:16:37 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:16:37 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:16:37 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:16:37 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:16:37 user nova-compute[75279]:   </clock>
Nov 11 00:16:37 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:16:37 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:16:37 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:16:37 user nova-compute[75279]:   </cpu>
Nov 11 00:16:37 user nova-compute[75279]:   <devices>
Nov 11 00:16:37 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:16:37 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:16:37 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk"/>
Nov 11 00:16:37 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:16:37 user nova-compute[75279]:     </disk>
Nov 11 00:16:37 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:16:37 user nova-compute[75279]:       <mac address="fa:16:3e:f5:99:36"/>
Nov 11 00:16:37 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:16:37 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:16:37 user nova-compute[75279]:       <target dev="tap4eb70b58-b4"/>
Nov 11 00:16:37 user nova-compute[75279]:     </interface>
Nov 11 00:16:37 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:16:37 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/console.log" append="off"/>
Nov 11 00:16:37 user nova-compute[75279]:     </serial>
Nov 11 00:16:37 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:16:37 user nova-compute[75279]:     <video>
Nov 11 00:16:37 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:16:37 user nova-compute[75279]:     </video>
Nov 11 00:16:37 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:16:37 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:16:37 user nova-compute[75279]:     </rng>
Nov 11 00:16:37 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:16:37 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:16:37 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:16:37 user nova-compute[75279]:     </memballoon>
Nov 11 00:16:37 user nova-compute[75279]:   </devices>
Nov 11 00:16:37 user nova-compute[75279]: </domain>
Nov 11 00:16:37 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1903099657',display_name='tempest-VolumesNegativeTest-instance-1903099657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1903099657',id=29,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0df13d96fd4216b0b59d82e1bdf05c',ramdisk_id='',reservation_id='r-rmgz0g6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1516485250',owner_user_name='tempest-VolumesNegativeTest-1516485250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:16:35Z,user_data=None,user_id='882e3263349644018816651225b7c1c0',uuid=2bf12758-cc0d-47dc-8582-cfeadc9ea2f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converting VIF {"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG os_vif [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b6bfe6a-4202-5410-b429-b62b617d1ab9', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eb70b58-b4, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4eb70b58-b4, col_values=(('qos', UUID('43780d31-2a3d-4a6b-bfdb-f94eaca98426')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4eb70b58-b4, col_values=(('external_ids', {'iface-id': '4eb70b58-b4c6-4954-8dcc-2ba921665429', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:99:36', 'vm-uuid': '2bf12758-cc0d-47dc-8582-cfeadc9ea2f0'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: INFO os_vif [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4')
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] No VIF found with MAC fa:16:3e:f5:99:36, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.neutron [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Updated VIF entry in instance network info cache for port 4eb70b58-b4c6-4954-8dcc-2ba921665429. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG nova.network.neutron [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Updating instance_info_cache with network_info: [{"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a048357b-2c8a-4a41-85f7-13abde07f007 req-b7c9aa72-54b5-4b5f-9bac-24362def62e6 service nova] Releasing lock "refresh_cache-2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:38 user nova-compute[75279]: INFO nova.compute.manager [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Terminating instance
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:38 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing instance network info cache due to event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-unplugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] No waiting events found dispatching network-vif-unplugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-09a618eb-479e-4458-ad36-5a1990788717 req-541eff46-b014-4409-8f0c-605678b5018a service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-unplugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updated VIF entry in instance network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing instance network info cache due to event network-changed-89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquired lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Refreshing network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Instance destroyed successfully.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'resources' on Instance uuid e685210c-addc-45e1-a665-ab603c5f3340 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-568592888',display_name='tempest-AttachVolumeNegativeTest-server-568592888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-568592888',id=26,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH/AemGVduMVPSIB51/MYAt9EQDrgooh4jhF2ET1RfCmL+Sb0NX6hNWLTgf+0K05rFUy9VifCWZUpTPOVeM31Gk8Ps2ekEP3hY2CbbSNEj8qV+ZPWPY2K4qxtmh2sb29w==',key_name='tempest-keypair-1395581038',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-dxy51lvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=e685210c-addc-45e1-a665-ab603c5f3340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "address": "fa:16:3e:14:e6:7c", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1a8e8-04", "ovs_interfaceid": "58a1a8e8-041e-4e12-8540-0fcfa0837a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG os_vif [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58a1a8e8-04, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updated VIF entry in instance network info cache for port 89ea421e-b556-4145-b66e-7a09854cfc60. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [{"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Releasing lock "refresh_cache-9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:39 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:39 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:39 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:39 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:39 user nova-compute[75279]: WARNING nova.compute.manager [req-6fc89cfa-3c84-4c0f-a479-ad78ff750579 req-b5852528-0dd4-49ab-9abc-26decf5494f1 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44db1365-fa1e-43c6-a45d-b100250e78ce) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:39 user nova-compute[75279]: INFO os_vif [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:e6:7c,bridge_name='br-int',has_traffic_filtering=True,id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58a1a8e8-04')
Nov 11 00:16:39 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Deleting instance files /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340_del
Nov 11 00:16:39 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Deletion of /opt/stack/data/nova/instances/e685210c-addc-45e1-a665-ab603c5f3340_del complete
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:39 user nova-compute[75279]: INFO nova.compute.manager [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:40 user nova-compute[75279]: WARNING nova.compute.manager [req-0b7261a1-13d1-42fb-9c11-de3cf448406b req-269964d7-2ce0-4aa9-a6f7-8a67e197329d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Acquiring lock "e685210c-addc-45e1-a665-ab603c5f3340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Lock "e685210c-addc-45e1-a665-ab603c5f3340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] No waiting events found dispatching network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:40 user nova-compute[75279]: WARNING nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received unexpected event network-vif-plugged-58a1a8e8-041e-4e12-8540-0fcfa0837a4f for instance with vm_state active and task_state deleting.
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] No waiting events found dispatching network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:40 user nova-compute[75279]: WARNING nova.compute.manager [req-4ace5836-c3af-46c8-bb68-3753fdcc29e8 req-50b24a51-f4a5-4a71-8466-34a925ba53b0 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received unexpected event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 for instance with vm_state building and task_state spawning.
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:40 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Took 1.00 seconds to deallocate network for instance.
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-50d9dad5-2f13-4e08-9edd-1ba79e8540ed req-95f7bd16-16f9-4ccb-a441-88fdf33f21b9 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Received event network-vif-deleted-58a1a8e8-041e-4e12-8540-0fcfa0837a4f {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:40 user nova-compute[75279]: INFO nova.compute.manager [req-50d9dad5-2f13-4e08-9edd-1ba79e8540ed req-95f7bd16-16f9-4ccb-a441-88fdf33f21b9 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Neutron deleted interface 58a1a8e8-041e-4e12-8540-0fcfa0837a4f; detaching it from the instance and deleting it from the info cache
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-50d9dad5-2f13-4e08-9edd-1ba79e8540ed req-95f7bd16-16f9-4ccb-a441-88fdf33f21b9 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-50d9dad5-2f13-4e08-9edd-1ba79e8540ed req-95f7bd16-16f9-4ccb-a441-88fdf33f21b9 service nova] [instance: e685210c-addc-45e1-a665-ab603c5f3340] Detach interface failed, port_id=58a1a8e8-041e-4e12-8540-0fcfa0837a4f, reason: Instance e685210c-addc-45e1-a665-ab603c5f3340 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.651s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8a9566d8-41cd-458b-b131-3357c0182a13 tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:16:41 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Deleted allocations for instance e685210c-addc-45e1-a665-ab603c5f3340
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2f85dc3d-a37b-4281-8b27-5b111765e9b3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "e685210c-addc-45e1-a665-ab603c5f3340" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.584s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:16:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Instance spawned successfully.
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:42 user nova-compute[75279]: INFO nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Took 7.56 seconds to spawn the instance on the hypervisor.
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:42 user nova-compute[75279]: INFO nova.compute.manager [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Took 8.73 seconds to build instance.
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f395225e-64ca-4a29-8a69-06004319efd7 tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.883s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] No waiting events found dispatching network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:16:42 user nova-compute[75279]: WARNING nova.compute.manager [req-5e01f995-f932-4043-bc32-565185f3f2f3 req-42f41257-7332-4a50-bcb9-1926edbbda92 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received unexpected event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 for instance with vm_state active and task_state None.
Nov 11 00:16:42 user nova-compute[75279]: INFO nova.compute.manager [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] instance snapshotting
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Beginning live snapshot process
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'e685210c-addc-45e1-a665-ab603c5f3340' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e685210c-addc-45e1-a665-ab603c5f3340' (instance-0000001a)
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.717s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60.delta 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=25.051071166992188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60.delta 1073741824" returned: 0 in 0.068s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 as it has an incoming, in-progress migration b8f8b380-62e1-4633-af9b-a77738d1c507. Migration status is finished {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:16:44 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating resource usage from migration b8f8b380-62e1-4633-af9b-a77738d1c507
Nov 11 00:16:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a77456b7-3d4c-40a9-94f7-661efc298e50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration b8f8b380-62e1-4633-af9b-a77738d1c507 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:16:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:16:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 00:16:46 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:16:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60.delta /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60.delta /opt/stack/data/nova/instances/snapshots/tmptbxfjdxz/0a4be96f31e24dc0b8cb84bd18529c60" returned: 0 in 0.659s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Snapshot extracted, beginning image upload
Nov 11 00:16:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:16:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Snapshot image upload complete
Nov 11 00:16:49 user nova-compute[75279]: INFO nova.compute.manager [None req-8d1e7dd9-82b3-48f9-a395-02f745855af4 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Took 7.03 seconds to snapshot the instance on the hypervisor.
Nov 11 00:16:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:57 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:16:57 user nova-compute[75279]: INFO nova.compute.claims [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Claim successful on node user
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:16:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.policy [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '456ee0c643b348d59145b05cbaa9fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158d2b8b80664ad6b19aea5cdb6256dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:16:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Creating image(s)
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "/opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "/opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "/opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk 1073741824" returned: 0 in 0.151s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Successfully created port: 7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Cannot resize image /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Ensure instance console log exists: /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:16:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Successfully updated port: 7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquired lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-changed-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Refreshing instance network info cache due to event network-changed-7e1799ab-1710-4018-9430-e0b30594c452. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] Acquiring lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating instance_info_cache with network_info: [{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Releasing lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Instance network_info: |[{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] Acquired lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Refreshing network info cache for port 7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Start _get_guest_xml network_info=[{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:17:00 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:00 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-743921993',display_name='tempest-SnapshotDataIntegrityTests-server-743921993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-743921993',id=30,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD/VvBY5PUnq1NMR/AlQDQdf3zk+UZ23VFZuc6bkcN8xx//nKdmIg5cG4T+xlmsb9gGKH8SHmPSmuiGYYaNi3nc/M5sSYXaL+814w9g47d3/c8/+yHZ1kClQZP4TVJ+7Q==',key_name='tempest-keypair-2057103682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='158d2b8b80664ad6b19aea5cdb6256dd',ramdisk_id='',reservation_id='r-btrgrsw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1016885518',owner_user_name='tempest-SnapshotDataIntegrityTests-1016885518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='456ee0c643b348d59145b05cbaa9fc19',uuid=0162b017-6a6d-4795-a859-e1a591c5c69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converting VIF {"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'pci_devices' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:17:00 user nova-compute[75279]:   <uuid>0162b017-6a6d-4795-a859-e1a591c5c69b</uuid>
Nov 11 00:17:00 user nova-compute[75279]:   <name>instance-0000001e</name>
Nov 11 00:17:00 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:17:00 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:17:00 user nova-compute[75279]:   <metadata>
Nov 11 00:17:00 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:17:00 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-743921993</nova:name>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:17:00</nova:creationTime>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:17:00 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:17:00 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:owner>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:user uuid="456ee0c643b348d59145b05cbaa9fc19">tempest-SnapshotDataIntegrityTests-1016885518-project-member</nova:user>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:project uuid="158d2b8b80664ad6b19aea5cdb6256dd">tempest-SnapshotDataIntegrityTests-1016885518</nova:project>
Nov 11 00:17:00 user nova-compute[75279]:       </nova:owner>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:17:00 user nova-compute[75279]:       <nova:ports>
Nov 11 00:17:00 user nova-compute[75279]:         <nova:port uuid="7e1799ab-1710-4018-9430-e0b30594c452">
Nov 11 00:17:00 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:17:00 user nova-compute[75279]:         </nova:port>
Nov 11 00:17:00 user nova-compute[75279]:       </nova:ports>
Nov 11 00:17:00 user nova-compute[75279]:     </nova:instance>
Nov 11 00:17:00 user nova-compute[75279]:   </metadata>
Nov 11 00:17:00 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:17:00 user nova-compute[75279]:     <system>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="serial">0162b017-6a6d-4795-a859-e1a591c5c69b</entry>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="uuid">0162b017-6a6d-4795-a859-e1a591c5c69b</entry>
Nov 11 00:17:00 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:17:00 user nova-compute[75279]:     </system>
Nov 11 00:17:00 user nova-compute[75279]:   </sysinfo>
Nov 11 00:17:00 user nova-compute[75279]:   <os>
Nov 11 00:17:00 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:17:00 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:17:00 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:17:00 user nova-compute[75279]:   </os>
Nov 11 00:17:00 user nova-compute[75279]:   <features>
Nov 11 00:17:00 user nova-compute[75279]:     <acpi/>
Nov 11 00:17:00 user nova-compute[75279]:     <apic/>
Nov 11 00:17:00 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:17:00 user nova-compute[75279]:   </features>
Nov 11 00:17:00 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:17:00 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:17:00 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:17:00 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:17:00 user nova-compute[75279]:   </clock>
Nov 11 00:17:00 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:17:00 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:17:00 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:17:00 user nova-compute[75279]:   </cpu>
Nov 11 00:17:00 user nova-compute[75279]:   <devices>
Nov 11 00:17:00 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:17:00 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:17:00 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk"/>
Nov 11 00:17:00 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:17:00 user nova-compute[75279]:     </disk>
Nov 11 00:17:00 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:17:00 user nova-compute[75279]:       <mac address="fa:16:3e:18:d9:aa"/>
Nov 11 00:17:00 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:17:00 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:17:00 user nova-compute[75279]:       <target dev="tap7e1799ab-17"/>
Nov 11 00:17:00 user nova-compute[75279]:     </interface>
Nov 11 00:17:00 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:17:00 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/console.log" append="off"/>
Nov 11 00:17:00 user nova-compute[75279]:     </serial>
Nov 11 00:17:00 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:17:00 user nova-compute[75279]:     <video>
Nov 11 00:17:00 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:17:00 user nova-compute[75279]:     </video>
Nov 11 00:17:00 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:17:00 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:17:00 user nova-compute[75279]:     </rng>
Nov 11 00:17:00 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:17:00 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:17:00 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:17:00 user nova-compute[75279]:     </memballoon>
Nov 11 00:17:00 user nova-compute[75279]:   </devices>
Nov 11 00:17:00 user nova-compute[75279]: </domain>
Nov 11 00:17:00 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-743921993',display_name='tempest-SnapshotDataIntegrityTests-server-743921993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-743921993',id=30,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD/VvBY5PUnq1NMR/AlQDQdf3zk+UZ23VFZuc6bkcN8xx//nKdmIg5cG4T+xlmsb9gGKH8SHmPSmuiGYYaNi3nc/M5sSYXaL+814w9g47d3/c8/+yHZ1kClQZP4TVJ+7Q==',key_name='tempest-keypair-2057103682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='158d2b8b80664ad6b19aea5cdb6256dd',ramdisk_id='',reservation_id='r-btrgrsw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1016885518',owner_user_name='tempest-SnapshotDataIntegrityTests-1016885518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='456ee0c643b348d59145b05cbaa9fc19',uuid=0162b017-6a6d-4795-a859-e1a591c5c69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converting VIF {"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG os_vif [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19c461cf-6a62-5620-bb78-2d7e1574bab5', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e1799ab-17, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e1799ab-17, col_values=(('qos', UUID('b2d481dd-9305-4716-9c01-d913e9beeaf4')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e1799ab-17, col_values=(('external_ids', {'iface-id': '7e1799ab-1710-4018-9430-e0b30594c452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:d9:aa', 'vm-uuid': '0162b017-6a6d-4795-a859-e1a591c5c69b'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:00 user nova-compute[75279]: INFO os_vif [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17')
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:17:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No VIF found with MAC fa:16:3e:18:d9:aa, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:17:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updated VIF entry in instance network info cache for port 7e1799ab-1710-4018-9430-e0b30594c452. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:17:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating instance_info_cache with network_info: [{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-51a76a4e-7084-48f6-ad71-e38a8301feae req-19cc053f-3b6f-4c7d-8694-2e576d385349 service nova] Releasing lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] No waiting events found dispatching network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:02 user nova-compute[75279]: WARNING nova.compute.manager [req-0b437ab7-8426-4395-937b-060f1dae4984 req-992ffd74-487e-4f0c-8806-ba4b1470d55b service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received unexpected event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 for instance with vm_state building and task_state spawning.
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:17:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Instance spawned successfully.
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] No waiting events found dispatching network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:04 user nova-compute[75279]: WARNING nova.compute.manager [req-7fdb6a05-4104-4452-8076-dfd352f82631 req-327fa396-aa98-4976-8ff9-0de375f54367 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received unexpected event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 for instance with vm_state building and task_state spawning.
Nov 11 00:17:04 user nova-compute[75279]: INFO nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 11 00:17:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:17:04 user nova-compute[75279]: INFO nova.compute.manager [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Took 6.92 seconds to build instance.
Nov 11 00:17:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b5e441b6-c5e5-4b3c-addd-5b7b45526e5d tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:08 user nova-compute[75279]: INFO nova.compute.manager [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Detaching volume a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:17:08 user nova-compute[75279]: INFO nova.virt.block_device [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Attempting to driver detach volume a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e from mountpoint /dev/vdb
Nov 11 00:17:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Attempting to detach device vdb from instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:17:08 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:17:08 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:17:08 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:17:08 user nova-compute[75279]:   <serial>a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e</serial>
Nov 11 00:17:08 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:17:08 user nova-compute[75279]: </disk>
Nov 11 00:17:08 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:17:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Successfully detached device vdb from instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d from the persistent domain config.
Nov 11 00:17:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:17:08 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:17:08 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:17:08 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:17:08 user nova-compute[75279]:   <serial>a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e</serial>
Nov 11 00:17:08 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:17:08 user nova-compute[75279]: </disk>
Nov 11 00:17:08 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:08 user nova-compute[75279]: INFO nova.compute.manager [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Terminating instance
Nov 11 00:17:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-dae51e25-ac31-4915-8e71-33bf9087d37e req-fd132b16-80f3-40b2-8e91-eac219d2552c service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-unplugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Instance destroyed successfully.
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid a77456b7-3d4c-40a9-94f7-661efc298e50 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-407627822',display_name='tempest-ServerRescueNegativeTestJSON-server-407627822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-407627822',id=4,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-ziwtxk2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:01:27Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=a77456b7-3d4c-40a9-94f7-661efc298e50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "address": "fa:16:3e:02:ee:8d", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395f7bdd-9c", "ovs_interfaceid": "395f7bdd-9cce-4d32-a364-d02403ccbd89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG os_vif [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap395f7bdd-9c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0ce4d3f-7f42-4316-9e92-41e25738b27b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:09 user nova-compute[75279]: INFO os_vif [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ee:8d,bridge_name='br-int',has_traffic_filtering=True,id=395f7bdd-9cce-4d32-a364-d02403ccbd89,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395f7bdd-9c')
Nov 11 00:17:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Deleting instance files /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50_del
Nov 11 00:17:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Deletion of /opt/stack/data/nova/instances/a77456b7-3d4c-40a9-94f7-661efc298e50_del complete
Nov 11 00:17:09 user nova-compute[75279]: INFO nova.compute.manager [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 11 00:17:09 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:17:09 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:10 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Took 0.54 seconds to deallocate network for instance.
Nov 11 00:17:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-316e38f2-919e-438b-a541-645dde4773de req-f697e527-bcc4-4357-8c41-92144bf809ce service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-deleted-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:10 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Deleted allocations for instance a77456b7-3d4c-40a9-94f7-661efc298e50
Nov 11 00:17:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e3413a63-1bf6-46bb-a7ba-308b6a799250 tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] Acquiring lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] Lock "a77456b7-3d4c-40a9-94f7-661efc298e50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] No waiting events found dispatching network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:11 user nova-compute[75279]: WARNING nova.compute.manager [req-818e4705-41ac-4117-950e-8eadc8acdb31 req-da33dd9d-903c-422f-a7e2-ee6ce5ee91d4 service nova] [instance: a77456b7-3d4c-40a9-94f7-661efc298e50] Received unexpected event network-vif-plugged-395f7bdd-9cce-4d32-a364-d02403ccbd89 for instance with vm_state deleted and task_state None.
Nov 11 00:17:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Going to confirm migration 1 {{(pid=75279) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:17:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'info_cache' on Instance uuid c6e1b6b4-8688-4d28-b8e0-6828053720f1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'migration_context' on Instance uuid c6e1b6b4-8688-4d28-b8e0-6828053720f1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG nova.objects.base [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Object Instance<c6e1b6b4-8688-4d28-b8e0-6828053720f1> lazy-loaded attributes: info_cache,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.458s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:13 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Deleted allocation for migration b8f8b380-62e1-4633-af9b-a77738d1c507
Nov 11 00:17:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c1df436b-b2a8-4d7b-bfc9-a9992ebef3ad tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.435s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing instance network info cache due to event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:22 user nova-compute[75279]: DEBUG nova.network.neutron [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:17:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updated VIF entry in instance network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:17:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29674240-5924-4451-ae17-84a29d8caf68 req-1659eff6-7129-4e4c-bfc4-1790b5675553 service nova] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d is timed out.
Nov 11 00:17:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Successfully detached device vdb from instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d from the live domain config.
Nov 11 00:17:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxdpNnVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:17:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df423f33-c586-4f21-8ac0-6ee7a92c678e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:17:29 user nova-compute[75279]: No targets found.
Nov 11 00:17:29 user nova-compute[75279]: iSNS:
Nov 11 00:17:29 user nova-compute[75279]: No targets found.
Nov 11 00:17:29 user nova-compute[75279]: STATIC:
Nov 11 00:17:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e
Nov 11 00:17:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:17:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:17:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:17:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:17:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:17:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:17:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:17:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:17:29 user nova-compute[75279]: FIRMWARE:
Nov 11 00:17:29 user nova-compute[75279]: No targets found.
Nov 11 00:17:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:17:29 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:17:29 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[602a927d-8fbe-4d15-8be2-d4948ce49367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fd7cde-fa6e-4ac4-9a2a-1b032c406fef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:17:29 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:17:29 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:17:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:17:29 user nova-compute[75279]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e (non-flash)
Nov 11 00:17:29 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:17:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e07f29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[46175d4f-7a0d-43b3-8418-2e40d61c0396]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a354b959-dcac-40c0-9169-d374616827b3]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c6cd9-1773-4c5d-bc75-f4c4793abf2a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[652645e4-edfa-4ff7-af9c-63bf5fb13a5d]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6726d2-9dd7-4c33-9010-82117412f13e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc1324-10d9-49e2-aa22-9858d844b863]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260]
Nov 11 00:17:29 user nova-compute[75279]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e, portal: 172.16.0.220,3260] successful.
Nov 11 00:17:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a15d7e2e-4ac2-4123-9f19-bb55d5fd3a1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3856c1af-e0b7-4502-b3a3-141079c98386]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] <== disconnect_volume: return (342ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:29 user nova-compute[75279]: INFO nova.compute.manager [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Shelving
Nov 11 00:17:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG nova.compute.manager [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:30 user nova-compute[75279]: WARNING nova.compute.manager [req-a8cab1e2-b954-491d-9f18-138babc9847b req-96efacbd-c9eb-49b3-a021-0fb5c7cfca55 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state active and task_state shelving.
Nov 11 00:17:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance destroyed successfully.
Nov 11 00:17:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Beginning cold snapshot process
Nov 11 00:17:30 user nova-compute[75279]: DEBUG nova.objects.instance [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'flavor' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-29cea56a-fd1e-4d15-b7da-4439867acd5b tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.261s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:17:30 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk /opt/stack/data/nova/instances/snapshots/tmph6ibu1ro/5463977164aa46d08d77d03942da7a5f {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk /opt/stack/data/nova/instances/snapshots/tmph6ibu1ro/5463977164aa46d08d77d03942da7a5f" returned: 0 in 0.800s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:31 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Snapshot extracted, beginning image upload
Nov 11 00:17:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:32 user nova-compute[75279]: WARNING nova.compute.manager [req-a83afe6e-fa75-40f5-afe8-8566c6d47a28 req-f11bb58c-ff8b-48eb-9fc4-6b7656ec64a1 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:32 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:17:32 user nova-compute[75279]: INFO nova.compute.claims [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Claim successful on node user
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:17:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.policy [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1203d275ebd34ce1a5840ca4b34f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683d6ebfe4794b67b6ec49ce83a46745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:17:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Creating image(s)
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "/opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "/opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk 1073741824" returned: 0 in 0.049s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:17:33 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Successfully created port: dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Cannot resize image /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Ensure instance console log exists: /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Snapshot image upload complete
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:17:34 user nova-compute[75279]: INFO nova.compute.manager [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Shelve offloading
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Successfully updated port: dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:17:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance destroyed successfully.
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquired lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-changed-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Refreshing instance network info cache due to event network-changed-dff2e0bd-586f-4e19-8632-44f73cd18558. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] Acquiring lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:17:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updating instance_info_cache with network_info: [{"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Releasing lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Instance network_info: |[{"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] Acquired lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Refreshing network info cache for port dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Start _get_guest_xml network_info=[{"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:17:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:35 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530711539',display_name='tempest-AttachVolumeNegativeTest-server-530711539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530711539',id=31,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb0WA+zjeQm9hYhEm/2Jk9l4Ed21/du9GXpAluAYq8Kh2aJhdeiFuQY3Op/UlXzrJydRNe2/ktKBzhIZFStEZEid8GvUEukZaIVoe/rZ8nAMCev9VlbNoEkTwy8wA/QTQ==',key_name='tempest-keypair-391954778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-ux7izbxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=a32bd458-ae96-447d-8b49-fdbee548ef3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'pci_devices' on Instance uuid a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:17:35 user nova-compute[75279]:   <uuid>a32bd458-ae96-447d-8b49-fdbee548ef3f</uuid>
Nov 11 00:17:35 user nova-compute[75279]:   <name>instance-0000001f</name>
Nov 11 00:17:35 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:17:35 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:17:35 user nova-compute[75279]:   <metadata>
Nov 11 00:17:35 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:17:35 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeNegativeTest-server-530711539</nova:name>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:17:35</nova:creationTime>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:17:35 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:17:35 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:owner>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:user uuid="1203d275ebd34ce1a5840ca4b34f2754">tempest-AttachVolumeNegativeTest-1189596006-project-member</nova:user>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:project uuid="683d6ebfe4794b67b6ec49ce83a46745">tempest-AttachVolumeNegativeTest-1189596006</nova:project>
Nov 11 00:17:35 user nova-compute[75279]:       </nova:owner>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:17:35 user nova-compute[75279]:       <nova:ports>
Nov 11 00:17:35 user nova-compute[75279]:         <nova:port uuid="dff2e0bd-586f-4e19-8632-44f73cd18558">
Nov 11 00:17:35 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 00:17:35 user nova-compute[75279]:         </nova:port>
Nov 11 00:17:35 user nova-compute[75279]:       </nova:ports>
Nov 11 00:17:35 user nova-compute[75279]:     </nova:instance>
Nov 11 00:17:35 user nova-compute[75279]:   </metadata>
Nov 11 00:17:35 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:17:35 user nova-compute[75279]:     <system>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="serial">a32bd458-ae96-447d-8b49-fdbee548ef3f</entry>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="uuid">a32bd458-ae96-447d-8b49-fdbee548ef3f</entry>
Nov 11 00:17:35 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:17:35 user nova-compute[75279]:     </system>
Nov 11 00:17:35 user nova-compute[75279]:   </sysinfo>
Nov 11 00:17:35 user nova-compute[75279]:   <os>
Nov 11 00:17:35 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:17:35 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:17:35 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:17:35 user nova-compute[75279]:   </os>
Nov 11 00:17:35 user nova-compute[75279]:   <features>
Nov 11 00:17:35 user nova-compute[75279]:     <acpi/>
Nov 11 00:17:35 user nova-compute[75279]:     <apic/>
Nov 11 00:17:35 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:17:35 user nova-compute[75279]:   </features>
Nov 11 00:17:35 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:17:35 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:17:35 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:17:35 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:17:35 user nova-compute[75279]:   </clock>
Nov 11 00:17:35 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:17:35 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:17:35 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:17:35 user nova-compute[75279]:   </cpu>
Nov 11 00:17:35 user nova-compute[75279]:   <devices>
Nov 11 00:17:35 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:17:35 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:17:35 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk"/>
Nov 11 00:17:35 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:17:35 user nova-compute[75279]:     </disk>
Nov 11 00:17:35 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:17:35 user nova-compute[75279]:       <mac address="fa:16:3e:ae:22:7b"/>
Nov 11 00:17:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:17:35 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:17:35 user nova-compute[75279]:       <target dev="tapdff2e0bd-58"/>
Nov 11 00:17:35 user nova-compute[75279]:     </interface>
Nov 11 00:17:35 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:17:35 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/console.log" append="off"/>
Nov 11 00:17:35 user nova-compute[75279]:     </serial>
Nov 11 00:17:35 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:17:35 user nova-compute[75279]:     <video>
Nov 11 00:17:35 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:17:35 user nova-compute[75279]:     </video>
Nov 11 00:17:35 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:17:35 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:17:35 user nova-compute[75279]:     </rng>
Nov 11 00:17:35 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:17:35 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:17:35 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:17:35 user nova-compute[75279]:     </memballoon>
Nov 11 00:17:35 user nova-compute[75279]:   </devices>
Nov 11 00:17:35 user nova-compute[75279]: </domain>
Nov 11 00:17:35 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530711539',display_name='tempest-AttachVolumeNegativeTest-server-530711539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530711539',id=31,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb0WA+zjeQm9hYhEm/2Jk9l4Ed21/du9GXpAluAYq8Kh2aJhdeiFuQY3Op/UlXzrJydRNe2/ktKBzhIZFStEZEid8GvUEukZaIVoe/rZ8nAMCev9VlbNoEkTwy8wA/QTQ==',key_name='tempest-keypair-391954778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-ux7izbxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=a32bd458-ae96-447d-8b49-fdbee548ef3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG os_vif [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef746cc8-3f4f-5834-a572-acf6465f5f09', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff2e0bd-58, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdff2e0bd-58, col_values=(('qos', UUID('8a9faafe-9d5d-4c5d-8429-8d79b90e7219')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdff2e0bd-58, col_values=(('external_ids', {'iface-id': 'dff2e0bd-586f-4e19-8632-44f73cd18558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:22:7b', 'vm-uuid': 'a32bd458-ae96-447d-8b49-fdbee548ef3f'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: INFO os_vif [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58')
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:ae:22:7b, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updated VIF entry in instance network info cache for port dff2e0bd-586f-4e19-8632-44f73cd18558. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updating instance_info_cache with network_info: [{"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7619b95d-bd27-4754-b16a-dc13069c1dec req-6e10472c-1962-471a-af52-5627b78b2dfa service nova] Releasing lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance destroyed successfully.
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'resources' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJya/fopfTx2ZNMXgYZa1Aku8JCVN6HDwl1pMUB72CTdXAc/d983LmliDjZTafT4ZK9lrI+RLAaIA6PbRgZhJGQ+ndYx1WdF/Ey7SMLBvxoLXwXYmP0q24+Bsl5MiRPCqw==',key_name='tempest-keypair-58678597',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:17:34.597382',shelved_host='user',shelved_image_id='c2e172af-4622-48ec-bb51-19a018cd547b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG os_vif [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9abbe9-24, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing instance network info cache due to event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=748838f6-b057-4e40-8f02-2984c365bc5f) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:35 user nova-compute[75279]: INFO os_vif [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24')
Nov 11 00:17:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Deleting instance files /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1_del
Nov 11 00:17:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Deletion of /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1_del complete
Nov 11 00:17:35 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Deleted allocations for instance c2c05958-0016-4d89-9d1a-0c593b761ab1
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'numa_topology' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<c2c05958-0016-4d89-9d1a-0c593b761ab1> lazy-loaded attributes: resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.network.neutron [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updated VIF entry in instance network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.network.neutron [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-083aebc6-3e66-4bde-a236-27189bb1606c req-c9064527-651e-475f-b9f5-aca422746d23 service nova] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57da27b9-942f-410c-a087-fb99c63d6955 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.669s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] No waiting events found dispatching network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:36 user nova-compute[75279]: WARNING nova.compute.manager [req-b9581b85-1a15-4bab-82d7-d92ba691c6e7 req-98ad4baa-5e48-4090-b156-48d14df9812d service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received unexpected event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 for instance with vm_state building and task_state spawning.
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:17:38 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Instance spawned successfully.
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] No waiting events found dispatching network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:38 user nova-compute[75279]: WARNING nova.compute.manager [req-6c693973-dbb8-45da-96f5-63bab3f43bc5 req-254e882d-4999-423e-8b46-47a32bdbfeb4 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received unexpected event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 for instance with vm_state building and task_state spawning.
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:38 user nova-compute[75279]: INFO nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 11 00:17:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:39 user nova-compute[75279]: INFO nova.compute.manager [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Took 6.58 seconds to build instance.
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-696fbd51-c698-4c60-8725-5a76bab41ed3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:17:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:41 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:41 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=24.967872619628906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bb536aa-c923-4be4-a399-e5f1270bf463 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 600c2f85-9476-48eb-b37f-7e845469fc5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a32bd458-ae96-447d-8b49-fdbee548ef3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:17:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:17:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:17:43 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:43 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:17:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:17:51 user nova-compute[75279]: INFO nova.compute.claims [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Claim successful on node user
Nov 11 00:17:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:17:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:17:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:17:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:17:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:17:52 user nova-compute[75279]: DEBUG nova.policy [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223cf2dd1ecd4a12a5db181391692422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5707b16ebb6042e08f11590de3c92bca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:17:52 user nova-compute[75279]: INFO nova.virt.block_device [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Booting with volume-backed-image 94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6 at /dev/vda
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Successfully created port: 05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Successfully updated port: 05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-changed-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Refreshing instance network info cache due to event network-changed-05814dbb-1e90-40a2-87cd-647c87a46e86. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] Acquiring lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:17:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance network_info: |[{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] Acquired lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Refreshing network info cache for port 05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updated VIF entry in instance network info cache for port 05814dbb-1e90-40a2-87cd-647c87a46e86. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dc537272-8813-4654-b9f0-294a72d7dfc1 req-68c5bc97-3874-4682-96ff-d6e444b13d1f service nova] Releasing lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:56 user nova-compute[75279]: INFO nova.compute.manager [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Terminating instance
Nov 11 00:17:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-unplugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] No waiting events found dispatching network-vif-unplugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7c53278e-ae36-4f07-82ab-4253c8539682 req-682d44be-6537-4449-bbb5-504a944e4065 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-unplugged-90f983f8-1933-45e1-8366-2c4fefa038d4 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:17:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Instance destroyed successfully.
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lazy-loading 'resources' on Instance uuid 600c2f85-9476-48eb-b37f-7e845469fc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1179496731',display_name='tempest-AttachVolumeTestJSON-server-1179496731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1179496731',id=24,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE9B3NyBDi2DbZXtBn6/IO4gj48XW9adN0UZ2wkyitSbFFq5v81HxwsDukITlBqUibrA2izAkrkEyoGV1pYN4B/lP1f1QbAZtOXgwgVpO1FbeAGHSccSpOOKIAjIqV8Mw==',key_name='tempest-keypair-276396208',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1be6b384229b48c4b9cf6c8f134967d1',ramdisk_id='',reservation_id='r-sun10hm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-896218417',owner_user_name='tempest-AttachVolumeTestJSON-896218417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d3793bc64e645f3b220d49f6c409904',uuid=600c2f85-9476-48eb-b37f-7e845469fc5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converting VIF {"id": "90f983f8-1933-45e1-8366-2c4fefa038d4", "address": "fa:16:3e:33:8a:6e", "network": {"id": "b8a13949-94b2-4fdb-b419-2b642be9de41", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1634154491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be6b384229b48c4b9cf6c8f134967d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f983f8-19", "ovs_interfaceid": "90f983f8-1933-45e1-8366-2c4fefa038d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG os_vif [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90f983f8-19, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89a43ec3-6dab-407c-b0f0-14750810fe67) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: INFO os_vif [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:8a:6e,bridge_name='br-int',has_traffic_filtering=True,id=90f983f8-1933-45e1-8366-2c4fefa038d4,network=Network(b8a13949-94b2-4fdb-b419-2b642be9de41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f983f8-19')
Nov 11 00:17:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Deleting instance files /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d_del
Nov 11 00:17:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Deletion of /opt/stack/data/nova/instances/600c2f85-9476-48eb-b37f-7e845469fc5d_del complete
Nov 11 00:17:57 user nova-compute[75279]: INFO nova.compute.manager [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 11 00:17:57 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:17:57 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Took 0.63 seconds to deallocate network for instance.
Nov 11 00:17:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-5db8f96d-6f0c-40fc-bc7f-8bc12665bbc4 req-1cdb0524-1145-4c75-9541-9261feaf6855 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-deleted-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:58 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Deleted allocations for instance 600c2f85-9476-48eb-b37f-7e845469fc5d
Nov 11 00:17:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-68abefcc-393b-4ee7-b59d-137789143903 tempest-AttachVolumeTestJSON-896218417 tempest-AttachVolumeTestJSON-896218417-project-member] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.064s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] Acquiring lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] Lock "600c2f85-9476-48eb-b37f-7e845469fc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] No waiting events found dispatching network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:58 user nova-compute[75279]: WARNING nova.compute.manager [req-1b4dbb3c-1ad1-478f-a1eb-503d8b0e0de2 req-31a2a70e-3b69-436c-9fd3-7cf542882771 service nova] [instance: 600c2f85-9476-48eb-b37f-7e845469fc5d] Received unexpected event network-vif-plugged-90f983f8-1933-45e1-8366-2c4fefa038d4 for instance with vm_state deleted and task_state None.
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:59 user nova-compute[75279]: INFO nova.compute.manager [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Terminating instance
Nov 11 00:17:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: INFO nova.compute.manager [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Terminating instance
Nov 11 00:17:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:17:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-ed93cee2-4c32-436f-acf1-2cbf82770884 req-bd18db5c-c0ba-4fc9-a181-5d684136f7bd service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-unplugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Instance destroyed successfully.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lazy-loading 'resources' on Instance uuid 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Instance destroyed successfully.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lazy-loading 'resources' on Instance uuid 2bb536aa-c923-4be4-a399-e5f1270bf463 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1921956890',display_name='tempest-ServerStableDeviceRescueTest-server-1921956890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1921956890',id=21,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMCeSGzxyiY7bAQlNe8WIu4ZeS7J65pyMy65mRNjc0eXBNtRVvwbnuPZ46CQ4/6sh5ZZdiM+sYWv5WsTe3rDouP/EYxmRWMsad7rVl3pQH72/Pbmnu8azcy2nS2q9Dc+A==',key_name='tempest-keypair-1517673478',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed0d496f01e14cc385058072a738a75c',ramdisk_id='',reservation_id='r-4sliv25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-26625521',owner_user_name='tempest-ServerStableDeviceRescueTest-26625521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555cd57cc4c44e7db8846b432dd35fe3',uuid=9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converting VIF {"id": "89ea421e-b556-4145-b66e-7a09854cfc60", "address": "fa:16:3e:77:95:e8", "network": {"id": "ca4bca3e-ba1f-484e-87d6-47fb15de571c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-229028737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed0d496f01e14cc385058072a738a75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ea421e-b5", "ovs_interfaceid": "89ea421e-b556-4145-b66e-7a09854cfc60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG os_vif [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89ea421e-b5, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143249965',display_name='tempest-ServerRescueNegativeTestJSON-server-1143249965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143249965',id=3,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2918206b132a4855a996eac99bbf5706',ramdisk_id='',reservation_id='r-xxwya5w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948684747',owner_user_name='tempest-ServerRescueNegativeTestJSON-948684747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:06:50Z,user_data=None,user_id='818b35f397a6467f8dec8eb37cef2ed7',uuid=2bb536aa-c923-4be4-a399-e5f1270bf463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converting VIF {"id": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "address": "fa:16:3e:76:b7:97", "network": {"id": "aac6b655-e943-4c57-b607-4df2bdec0839", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2107783919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2918206b132a4855a996eac99bbf5706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491fd41c-8c", "ovs_interfaceid": "491fd41c-8c05-4bd0-881d-3e1a7c9beec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG os_vif [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491fd41c-8c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b08f6c30-3c46-4ec2-b395-241d285c4e5e) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36dffbbb-c3c2-4b6a-af03-15bcc5280853) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:00 user nova-compute[75279]: INFO os_vif [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:95:e8,bridge_name='br-int',has_traffic_filtering=True,id=89ea421e-b556-4145-b66e-7a09854cfc60,network=Network(ca4bca3e-ba1f-484e-87d6-47fb15de571c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ea421e-b5')
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Deleting instance files /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d_del
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Deletion of /opt/stack/data/nova/instances/9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d_del complete
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:00 user nova-compute[75279]: INFO os_vif [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b7:97,bridge_name='br-int',has_traffic_filtering=True,id=491fd41c-8c05-4bd0-881d-3e1a7c9beec6,network=Network(aac6b655-e943-4c57-b607-4df2bdec0839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491fd41c-8c')
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Deleting instance files /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463_del
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Deletion of /opt/stack/data/nova/instances/2bb536aa-c923-4be4-a399-e5f1270bf463_del complete
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.compute.manager [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:18:00 user nova-compute[75279]: INFO nova.compute.manager [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:00 user nova-compute[75279]: WARNING nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state deleting.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:00 user nova-compute[75279]: WARNING nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state deleting.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:00 user nova-compute[75279]: WARNING nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state active and task_state deleting.
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-90f65540-6bed-48c1-8f65-629c04464ea8 req-8965df7a-1ad4-49a1-9f48-a28221f6a13d service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-unplugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:01 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Took 0.62 seconds to deallocate network for instance.
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-aeef5ee0-f050-4ca0-a743-a14573b08424 req-17aac980-aa3e-4b60-8898-850f18683672 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-deleted-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:01 user nova-compute[75279]: INFO nova.compute.manager [req-aeef5ee0-f050-4ca0-a743-a14573b08424 req-17aac980-aa3e-4b60-8898-850f18683672 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Neutron deleted interface 89ea421e-b556-4145-b66e-7a09854cfc60; detaching it from the instance and deleting it from the info cache
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-aeef5ee0-f050-4ca0-a743-a14573b08424 req-17aac980-aa3e-4b60-8898-850f18683672 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:01 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Took 0.77 seconds to deallocate network for instance.
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-aeef5ee0-f050-4ca0-a743-a14573b08424 req-17aac980-aa3e-4b60-8898-850f18683672 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Detach interface failed, port_id=89ea421e-b556-4145-b66e-7a09854cfc60, reason: Instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.252s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:01 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Deleted allocations for instance 2bb536aa-c923-4be4-a399-e5f1270bf463
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9fcbb3db-5829-4b85-acac-54f96e10df3d tempest-ServerRescueNegativeTestJSON-948684747 tempest-ServerRescueNegativeTestJSON-948684747-project-member] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] Acquiring lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] Lock "2bb536aa-c923-4be4-a399-e5f1270bf463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] No waiting events found dispatching network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:01 user nova-compute[75279]: WARNING nova.compute.manager [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received unexpected event network-vif-plugged-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 for instance with vm_state deleted and task_state None.
Nov 11 00:18:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-2be37444-1905-4991-8b04-9c6616603839 req-d42fba7a-c5d0-414d-bc16-4e3a6ebc656a service nova] [instance: 2bb536aa-c923-4be4-a399-e5f1270bf463] Received event network-vif-deleted-491fd41c-8c05-4bd0-881d-3e1a7c9beec6 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:02 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Deleted allocations for instance 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d
Nov 11 00:18:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-091cf10c-06d4-45b3-bf47-1956cc768f0d tempest-ServerStableDeviceRescueTest-26625521 tempest-ServerStableDeviceRescueTest-26625521-project-member] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] Acquiring lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] Lock "9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] No waiting events found dispatching network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:02 user nova-compute[75279]: WARNING nova.compute.manager [req-5e8e29b5-6ad4-4ce0-8fcd-9559c3ec92d1 req-9b1c7f75-fd6b-43fb-b424-2c59410ed0a0 service nova] [instance: 9daf1490-c6fc-4c5e-a0e0-9473e2e9db4d] Received unexpected event network-vif-plugged-89ea421e-b556-4145-b66e-7a09854cfc60 for instance with vm_state deleted and task_state None.
Nov 11 00:18:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.utils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d0f61-e08a-4540-9684-6639b4830a5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a85935-a115-4243-b478-bca435ca3f6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5df60b2-67ba-43cc-b375-5f3ba8c8425c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84b8d9-b547-4997-b5a1-e5632509376f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:18:13 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:18:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806b293-9ef7-4dd0-bc26-a0afcdf48a15]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG os_brick.utils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:18:13 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating existing volume attachment record: 1f99a3d2-d522-4aaf-bc69-43daf7c1551e {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:18:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:23 user nova-compute[75279]: INFO nova.compute.manager [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Terminating instance
Nov 11 00:18:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-unplugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] No waiting events found dispatching network-vif-unplugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-48d0beee-42f2-4c1b-bffe-2f7e878f8f3b req-8337491a-3cce-4bc8-8246-ab56e987903f service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-unplugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:18:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Instance destroyed successfully.
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lazy-loading 'resources' on Instance uuid 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1903099657',display_name='tempest-VolumesNegativeTest-instance-1903099657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1903099657',id=29,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0df13d96fd4216b0b59d82e1bdf05c',ramdisk_id='',reservation_id='r-rmgz0g6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1516485250',owner_user_name='tempest-VolumesNegativeTest-1516485250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:16:42Z,user_data=None,user_id='882e3263349644018816651225b7c1c0',uuid=2bf12758-cc0d-47dc-8582-cfeadc9ea2f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converting VIF {"id": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "address": "fa:16:3e:f5:99:36", "network": {"id": "4abeba01-71a6-4721-9547-4ba705ee2c5c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d47a5ee077ef48929489419ccc7ffff9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb70b58-b4", "ovs_interfaceid": "4eb70b58-b4c6-4954-8dcc-2ba921665429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG os_vif [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eb70b58-b4, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43780d31-2a3d-4a6b-bfdb-f94eaca98426) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:24 user nova-compute[75279]: INFO os_vif [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:99:36,bridge_name='br-int',has_traffic_filtering=True,id=4eb70b58-b4c6-4954-8dcc-2ba921665429,network=Network(4abeba01-71a6-4721-9547-4ba705ee2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb70b58-b4')
Nov 11 00:18:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Deleting instance files /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0_del
Nov 11 00:18:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Deletion of /opt/stack/data/nova/instances/2bf12758-cc0d-47dc-8582-cfeadc9ea2f0_del complete
Nov 11 00:18:24 user nova-compute[75279]: INFO nova.compute.manager [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 11 00:18:24 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:24 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Took 0.45 seconds to deallocate network for instance.
Nov 11 00:18:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:25 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Deleted allocations for instance 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0
Nov 11 00:18:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-72afa363-0ef2-4d7d-82a1-91f9eb1eca8a tempest-VolumesNegativeTest-1516485250 tempest-VolumesNegativeTest-1516485250-project-member] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.849s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] Acquiring lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] Lock "2bf12758-cc0d-47dc-8582-cfeadc9ea2f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] No waiting events found dispatching network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:18:25 user nova-compute[75279]: WARNING nova.compute.manager [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received unexpected event network-vif-plugged-4eb70b58-b4c6-4954-8dcc-2ba921665429 for instance with vm_state deleted and task_state None.
Nov 11 00:18:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-7724339c-207c-45fd-9d7a-0638eb28173b req-fbca61c9-7015-4342-b98d-988b04bc4f08 service nova] [instance: 2bf12758-cc0d-47dc-8582-cfeadc9ea2f0] Received event network-vif-deleted-4eb70b58-b4c6-4954-8dcc-2ba921665429 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:33 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:18:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:18:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.138652801513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a32bd458-ae96-447d-8b49-fdbee548ef3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:18:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:18:39 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:18:39 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:18:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:39 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:18:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:18:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [{"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-c6e1b6b4-8688-4d28-b8e0-6828053720f1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:18:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:18:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:18:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-changed-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:18:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Refreshing instance network info cache due to event network-changed-7e1799ab-1710-4018-9430-e0b30594c452. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:18:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] Acquiring lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:18:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] Acquired lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:18:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Refreshing network info cache for port 7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:18:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:49 user nova-compute[75279]: DEBUG nova.network.neutron [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updated VIF entry in instance network info cache for port 7e1799ab-1710-4018-9430-e0b30594c452. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:18:49 user nova-compute[75279]: DEBUG nova.network.neutron [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating instance_info_cache with network_info: [{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:18:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30f8f964-71ba-48af-85a1-883b1bb1b21e req-c4da31b5-7afe-4947-a6cd-cd500ad280cb service nova] Releasing lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:18:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:18:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:58 user nova-compute[75279]: INFO nova.compute.manager [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attaching volume 39bd9609-791e-4551-9ccf-e0b97481b655 to /dev/vdb
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.utils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e458c82-9d39-4873-bc3e-eb5f8c851c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f9568-31ed-48f9-8d55-192178826572]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17f6282-ab98-414f-83a2-2ab877479507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2507da19-2fc4-4c60-87de-77a83a66fe5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:18:58 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123804e-2f61-4281-99be-bc2995e9210c]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.utils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating existing volume attachment record: 99caa2df-85e9-44de-9083-feef9ed28012 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:18:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Creating image(s)
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Ensure instance console log exists: /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start _get_guest_xml network_info=[{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f4c4be6-988e-4769-84f6-cead8adf4d07', 'attached_at': '', 'detached_at': '', 'volume_id': '5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'serial': '5df5ab7e-102d-4438-8dba-f68e86bb3eb6'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1f99a3d2-d522-4aaf-bc69-43daf7c1551e', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:18:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:18:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:18:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:18:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:18:58 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4eb26-21f7-4f9f-9818-7907fa8fa454]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:18:58 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7361e-6151-4424-b791-a845db020fbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6] added
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1afab3f-cd78-47fb-a49e-d824b71be0bd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c430f-80f4-4403-9ed9-3969f0a8a763]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbcqlWhV {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbcqlWhV" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa3be6-7133-4160-9410-b16e57e46598]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbcqlWhV'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89abb7-ab0f-4d2b-9264-b1255d2d2b8f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14ce42b-4414-46d1-beb1-dae515b0aeea]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6e9f7-9c84-416d-a56b-e5b2e1cd12c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260]
Nov 11 00:18:58 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260] successful.
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[376edad3-098e-4710-872a-0066984a1a66]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b562404-dc1e-4aee-b9e5-6cc890097140]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:18:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059e45d-4a3b-4cf0-94da-d4cea17c4227]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:18:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:18:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:18:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:18:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23532373139623332', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:18:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532373139623332', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536087322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536087322',id=32,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-4294y3j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:17:52Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=8f4c4be6-988e-4769-84f6-cead8adf4d07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:19:00 user nova-compute[75279]:   <uuid>8f4c4be6-988e-4769-84f6-cead8adf4d07</uuid>
Nov 11 00:19:00 user nova-compute[75279]:   <name>instance-00000020</name>
Nov 11 00:19:00 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:19:00 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:19:00 user nova-compute[75279]:   <metadata>
Nov 11 00:19:00 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:19:00 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1536087322</nova:name>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:18:58</nova:creationTime>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:19:00 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:19:00 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:owner>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:19:00 user nova-compute[75279]:       </nova:owner>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:19:00 user nova-compute[75279]:       <nova:ports>
Nov 11 00:19:00 user nova-compute[75279]:         <nova:port uuid="05814dbb-1e90-40a2-87cd-647c87a46e86">
Nov 11 00:19:00 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 00:19:00 user nova-compute[75279]:         </nova:port>
Nov 11 00:19:00 user nova-compute[75279]:       </nova:ports>
Nov 11 00:19:00 user nova-compute[75279]:     </nova:instance>
Nov 11 00:19:00 user nova-compute[75279]:   </metadata>
Nov 11 00:19:00 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:19:00 user nova-compute[75279]:     <system>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="serial">8f4c4be6-988e-4769-84f6-cead8adf4d07</entry>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="uuid">8f4c4be6-988e-4769-84f6-cead8adf4d07</entry>
Nov 11 00:19:00 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:19:00 user nova-compute[75279]:     </system>
Nov 11 00:19:00 user nova-compute[75279]:   </sysinfo>
Nov 11 00:19:00 user nova-compute[75279]:   <os>
Nov 11 00:19:00 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:19:00 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:19:00 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:19:00 user nova-compute[75279]:   </os>
Nov 11 00:19:00 user nova-compute[75279]:   <features>
Nov 11 00:19:00 user nova-compute[75279]:     <acpi/>
Nov 11 00:19:00 user nova-compute[75279]:     <apic/>
Nov 11 00:19:00 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:19:00 user nova-compute[75279]:   </features>
Nov 11 00:19:00 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:19:00 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:19:00 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:19:00 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:19:00 user nova-compute[75279]:   </clock>
Nov 11 00:19:00 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:19:00 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:19:00 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:19:00 user nova-compute[75279]:   </cpu>
Nov 11 00:19:00 user nova-compute[75279]:   <devices>
Nov 11 00:19:00 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:19:00 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:19:00 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:19:00 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:19:00 user nova-compute[75279]:       <serial>5df5ab7e-102d-4438-8dba-f68e86bb3eb6</serial>
Nov 11 00:19:00 user nova-compute[75279]:     </disk>
Nov 11 00:19:00 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:19:00 user nova-compute[75279]:       <mac address="fa:16:3e:ce:8b:71"/>
Nov 11 00:19:00 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:00 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:19:00 user nova-compute[75279]:       <target dev="tap05814dbb-1e"/>
Nov 11 00:19:00 user nova-compute[75279]:     </interface>
Nov 11 00:19:00 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:19:00 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/console.log" append="off"/>
Nov 11 00:19:00 user nova-compute[75279]:     </serial>
Nov 11 00:19:00 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:19:00 user nova-compute[75279]:     <video>
Nov 11 00:19:00 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:00 user nova-compute[75279]:     </video>
Nov 11 00:19:00 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:19:00 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:19:00 user nova-compute[75279]:     </rng>
Nov 11 00:19:00 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:19:00 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:19:00 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:19:00 user nova-compute[75279]:     </memballoon>
Nov 11 00:19:00 user nova-compute[75279]:   </devices>
Nov 11 00:19:00 user nova-compute[75279]: </domain>
Nov 11 00:19:00 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536087322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536087322',id=32,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-4294y3j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:17:52Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=8f4c4be6-988e-4769-84f6-cead8adf4d07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG os_vif [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '141b9a46-608e-5513-8fa9-4adb579f70cb', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05814dbb-1e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05814dbb-1e, col_values=(('qos', UUID('ccad239b-e779-4186-82cc-33b557b4f564')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05814dbb-1e, col_values=(('external_ids', {'iface-id': '05814dbb-1e90-40a2-87cd-647c87a46e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:8b:71', 'vm-uuid': '8f4c4be6-988e-4769-84f6-cead8adf4d07'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:00 user nova-compute[75279]: INFO os_vif [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e')
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:19:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:ce:8b:71, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:01 user nova-compute[75279]: WARNING nova.compute.manager [req-f2384240-bea6-4e37-863e-dfc88dffc1fd req-6c7a38f0-aebe-4605-90df-bd25299ea20d service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state building and task_state spawning.
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:03 user nova-compute[75279]: INFO nova.compute.manager [None req-06098054-473b-4f6b-94e8-7c8392dd2e1f tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Get console output
Nov 11 00:19:03 user nova-compute[75279]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:19:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance spawned successfully.
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:03 user nova-compute[75279]: WARNING nova.compute.manager [req-022b6326-63c1-4628-a1cc-c53626cb7e89 req-fbee5948-cb56-46a1-8d61-a8761020a55e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state building and task_state spawning.
Nov 11 00:19:03 user nova-compute[75279]: INFO nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 11 00:19:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:19:03 user nova-compute[75279]: INFO nova.compute.manager [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Took 72.49 seconds to build instance.
Nov 11 00:19:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3e4e9c76-fdaa-4fa7-9e18-8bbb5cc7ae75 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.608s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:20 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:19:20 user nova-compute[75279]: INFO nova.compute.claims [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Claim successful on node user
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:19:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:19:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.policy [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aef74e99ceba4defaecccad87c1bb56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf03d05069cd4066b9aa46cbc7eddc9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:19:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Creating image(s)
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "/opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "/opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk 1073741824" returned: 0 in 0.085s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.226s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Successfully created port: 84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Cannot resize image /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Ensure instance console log exists: /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:23 user nova-compute[75279]: INFO nova.compute.manager [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Unshelving
Nov 11 00:19:23 user nova-compute[75279]: INFO nova.virt.block_device [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Booting with volume 49c3f383-dd82-4319-bbed-bcfc5df7725d at /dev/vdc
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.utils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f5e456-223b-407b-9be2-f96a258a25b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f32db-7b74-4b58-85b1-717b4aed5338]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad741ce-0ccd-4d78-9e4d-f1c3365fb4c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde064d2-d812-4e18-b420-abeb53354b72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:19:23 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02637d-3a76-48da-b135-04704d0c2332]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG os_brick.utils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating existing volume attachment record: 289ebaac-6610-4467-a63f-10554db51d4d {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Successfully updated port: 84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquired lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-changed-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Refreshing instance network info cache due to event network-changed-84ed19da-6587-4c36-9c97-8ce7e4607dae. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] Acquiring lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-changed-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Refreshing instance network info cache due to event network-changed-dff2e0bd-586f-4e19-8632-44f73cd18558. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] Acquiring lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] Acquired lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Refreshing network info cache for port dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Releasing lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Instance network_info: |[{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] Acquired lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:19:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Refreshing network info cache for port 84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Start _get_guest_xml network_info=[{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:19:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424122669',display_name='tempest-ServersNegativeTestJSON-server-1424122669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424122669',id=33,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-sbqut8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:22Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=2dd490b4-6b20-4579-86c5-1e6b052389aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dd490b4-6b20-4579-86c5-1e6b052389aa {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:19:24 user nova-compute[75279]:   <uuid>2dd490b4-6b20-4579-86c5-1e6b052389aa</uuid>
Nov 11 00:19:24 user nova-compute[75279]:   <name>instance-00000021</name>
Nov 11 00:19:24 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:19:24 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:19:24 user nova-compute[75279]:   <metadata>
Nov 11 00:19:24 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:19:24 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:name>tempest-ServersNegativeTestJSON-server-1424122669</nova:name>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:19:24</nova:creationTime>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:19:24 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:19:24 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:owner>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:user uuid="aef74e99ceba4defaecccad87c1bb56c">tempest-ServersNegativeTestJSON-1846058883-project-member</nova:user>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:project uuid="cf03d05069cd4066b9aa46cbc7eddc9b">tempest-ServersNegativeTestJSON-1846058883</nova:project>
Nov 11 00:19:24 user nova-compute[75279]:       </nova:owner>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:19:24 user nova-compute[75279]:       <nova:ports>
Nov 11 00:19:24 user nova-compute[75279]:         <nova:port uuid="84ed19da-6587-4c36-9c97-8ce7e4607dae">
Nov 11 00:19:24 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 11 00:19:24 user nova-compute[75279]:         </nova:port>
Nov 11 00:19:24 user nova-compute[75279]:       </nova:ports>
Nov 11 00:19:24 user nova-compute[75279]:     </nova:instance>
Nov 11 00:19:24 user nova-compute[75279]:   </metadata>
Nov 11 00:19:24 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:19:24 user nova-compute[75279]:     <system>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="serial">2dd490b4-6b20-4579-86c5-1e6b052389aa</entry>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="uuid">2dd490b4-6b20-4579-86c5-1e6b052389aa</entry>
Nov 11 00:19:24 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:19:24 user nova-compute[75279]:     </system>
Nov 11 00:19:24 user nova-compute[75279]:   </sysinfo>
Nov 11 00:19:24 user nova-compute[75279]:   <os>
Nov 11 00:19:24 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:19:24 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:19:24 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:19:24 user nova-compute[75279]:   </os>
Nov 11 00:19:24 user nova-compute[75279]:   <features>
Nov 11 00:19:24 user nova-compute[75279]:     <acpi/>
Nov 11 00:19:24 user nova-compute[75279]:     <apic/>
Nov 11 00:19:24 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:19:24 user nova-compute[75279]:   </features>
Nov 11 00:19:24 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:19:24 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:19:24 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:19:24 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:19:24 user nova-compute[75279]:   </clock>
Nov 11 00:19:24 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:19:24 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:19:24 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:19:24 user nova-compute[75279]:   </cpu>
Nov 11 00:19:24 user nova-compute[75279]:   <devices>
Nov 11 00:19:24 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:19:24 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:19:24 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk"/>
Nov 11 00:19:24 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:19:24 user nova-compute[75279]:     </disk>
Nov 11 00:19:24 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:19:24 user nova-compute[75279]:       <mac address="fa:16:3e:1e:a7:c0"/>
Nov 11 00:19:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:24 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:19:24 user nova-compute[75279]:       <target dev="tap84ed19da-65"/>
Nov 11 00:19:24 user nova-compute[75279]:     </interface>
Nov 11 00:19:24 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:19:24 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/console.log" append="off"/>
Nov 11 00:19:24 user nova-compute[75279]:     </serial>
Nov 11 00:19:24 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:19:24 user nova-compute[75279]:     <video>
Nov 11 00:19:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:24 user nova-compute[75279]:     </video>
Nov 11 00:19:24 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:19:24 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:19:24 user nova-compute[75279]:     </rng>
Nov 11 00:19:24 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:19:24 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:19:24 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:19:24 user nova-compute[75279]:     </memballoon>
Nov 11 00:19:24 user nova-compute[75279]:   </devices>
Nov 11 00:19:24 user nova-compute[75279]: </domain>
Nov 11 00:19:24 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424122669',display_name='tempest-ServersNegativeTestJSON-server-1424122669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424122669',id=33,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-sbqut8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:22Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=2dd490b4-6b20-4579-86c5-1e6b052389aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG os_vif [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38df7e31-13bf-5ff0-a8ef-27817686d20a', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84ed19da-65, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84ed19da-65, col_values=(('qos', UUID('27dbfcab-acbf-449f-b336-492923e99d18')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84ed19da-65, col_values=(('external_ids', {'iface-id': '84ed19da-6587-4c36-9c97-8ce7e4607dae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a7:c0', 'vm-uuid': '2dd490b4-6b20-4579-86c5-1e6b052389aa'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:24 user nova-compute[75279]: INFO os_vif [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65')
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] No VIF found with MAC fa:16:3e:1e:a7:c0, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updated VIF entry in instance network info cache for port 84ed19da-6587-4c36-9c97-8ce7e4607dae. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:19:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43c02f2a-de6e-4721-b5ed-1c62e89f3c61 req-ca259be0-8cae-4246-bc82-5f2dbc609af5 service nova] Releasing lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG nova.network.neutron [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updated VIF entry in instance network info cache for port dff2e0bd-586f-4e19-8632-44f73cd18558. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG nova.network.neutron [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updating instance_info_cache with network_info: [{"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eacf44c6-a98a-4efd-ba13-f6148839c3dd req-9f790720-b7fe-4e2e-86bb-14bdcb942aa5 service nova] Releasing lock "refresh_cache-a32bd458-ae96-447d-8b49-fdbee548ef3f" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] No waiting events found dispatching network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:26 user nova-compute[75279]: WARNING nova.compute.manager [req-85cb371b-f8a0-4179-9dba-1d38f1c24f01 req-b5b052f6-20ea-4c73-a1ca-b788d4b9a79d service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received unexpected event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae for instance with vm_state building and task_state spawning.
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:19:26 user nova-compute[75279]: INFO nova.compute.claims [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Claim successful on node user
Nov 11 00:19:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:19:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.policy [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '457daf84e75945a1acf6662e94ee7299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa189dfa33b24dd9b7fbaeb2bdd59e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:19:26 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Creating image(s)
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "/opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "/opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:26 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk 1073741824" returned: 0 in 0.074s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.266s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Successfully created port: ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Cannot resize image /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Ensure instance console log exists: /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] No waiting events found dispatching network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:28 user nova-compute[75279]: WARNING nova.compute.manager [req-8d0de77f-3413-46cf-9bda-d1957af59402 req-1527c6ea-0096-441d-ac04-dcdc45747f6e service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received unexpected event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae for instance with vm_state building and task_state spawning.
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:19:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Instance spawned successfully.
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:28 user nova-compute[75279]: INFO nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:19:28 user nova-compute[75279]: INFO nova.compute.manager [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Took 7.98 seconds to build instance.
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9c807ef1-12f9-49d2-9f98-083888f66fc6 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.161s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Successfully updated port: ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquired lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-changed-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Refreshing instance network info cache due to event network-changed-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] Acquiring lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:19:28 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating instance_info_cache with network_info: [{"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Releasing lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Instance network_info: |[{"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] Acquired lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Refreshing network info cache for port ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Start _get_guest_xml network_info=[{"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1549556685',display_name='tempest-TestServerVolumeAttachmentScenario-server-1549556685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1549556685',id=34,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPfvzfeEFewBlZeLUkdDgkVwcJ8p2J2CeB9CzQ3/PqGNNDRZAl5ElQLUz4KUFZIKTXky3dEqPgkxHHHSAi+ArOHxs8VlRojZxv1X/nMopru4Ey6LCkmsrvxjUhyGB/FdA==',key_name='tempest-keypair-1001599202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa189dfa33b24dd9b7fbaeb2bdd59e2d',ramdisk_id='',reservation_id='r-nnidpssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1700496772',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1700496772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457daf84e75945a1acf6662e94ee7299',uuid=b0de1887-6095-4062-a882-6240e5231313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converting VIF {"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'pci_devices' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:19:29 user nova-compute[75279]:   <uuid>b0de1887-6095-4062-a882-6240e5231313</uuid>
Nov 11 00:19:29 user nova-compute[75279]:   <name>instance-00000022</name>
Nov 11 00:19:29 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:19:29 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:19:29 user nova-compute[75279]:   <metadata>
Nov 11 00:19:29 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:19:29 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1549556685</nova:name>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:19:29</nova:creationTime>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:19:29 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:19:29 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:owner>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:user uuid="457daf84e75945a1acf6662e94ee7299">tempest-TestServerVolumeAttachmentScenario-1700496772-project-member</nova:user>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:project uuid="aa189dfa33b24dd9b7fbaeb2bdd59e2d">tempest-TestServerVolumeAttachmentScenario-1700496772</nova:project>
Nov 11 00:19:29 user nova-compute[75279]:       </nova:owner>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:19:29 user nova-compute[75279]:       <nova:ports>
Nov 11 00:19:29 user nova-compute[75279]:         <nova:port uuid="ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970">
Nov 11 00:19:29 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 11 00:19:29 user nova-compute[75279]:         </nova:port>
Nov 11 00:19:29 user nova-compute[75279]:       </nova:ports>
Nov 11 00:19:29 user nova-compute[75279]:     </nova:instance>
Nov 11 00:19:29 user nova-compute[75279]:   </metadata>
Nov 11 00:19:29 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:19:29 user nova-compute[75279]:     <system>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="serial">b0de1887-6095-4062-a882-6240e5231313</entry>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="uuid">b0de1887-6095-4062-a882-6240e5231313</entry>
Nov 11 00:19:29 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:19:29 user nova-compute[75279]:     </system>
Nov 11 00:19:29 user nova-compute[75279]:   </sysinfo>
Nov 11 00:19:29 user nova-compute[75279]:   <os>
Nov 11 00:19:29 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:19:29 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:19:29 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:19:29 user nova-compute[75279]:   </os>
Nov 11 00:19:29 user nova-compute[75279]:   <features>
Nov 11 00:19:29 user nova-compute[75279]:     <acpi/>
Nov 11 00:19:29 user nova-compute[75279]:     <apic/>
Nov 11 00:19:29 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:19:29 user nova-compute[75279]:   </features>
Nov 11 00:19:29 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:19:29 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:19:29 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:19:29 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:19:29 user nova-compute[75279]:   </clock>
Nov 11 00:19:29 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:19:29 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:19:29 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:19:29 user nova-compute[75279]:   </cpu>
Nov 11 00:19:29 user nova-compute[75279]:   <devices>
Nov 11 00:19:29 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:19:29 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:19:29 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk"/>
Nov 11 00:19:29 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:19:29 user nova-compute[75279]:     </disk>
Nov 11 00:19:29 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:19:29 user nova-compute[75279]:       <mac address="fa:16:3e:08:b9:eb"/>
Nov 11 00:19:29 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:29 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:19:29 user nova-compute[75279]:       <target dev="tapff9b0fcd-07"/>
Nov 11 00:19:29 user nova-compute[75279]:     </interface>
Nov 11 00:19:29 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:19:29 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/console.log" append="off"/>
Nov 11 00:19:29 user nova-compute[75279]:     </serial>
Nov 11 00:19:29 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:19:29 user nova-compute[75279]:     <video>
Nov 11 00:19:29 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:19:29 user nova-compute[75279]:     </video>
Nov 11 00:19:29 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:19:29 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:19:29 user nova-compute[75279]:     </rng>
Nov 11 00:19:29 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:19:29 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:19:29 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:19:29 user nova-compute[75279]:     </memballoon>
Nov 11 00:19:29 user nova-compute[75279]:   </devices>
Nov 11 00:19:29 user nova-compute[75279]: </domain>
Nov 11 00:19:29 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1549556685',display_name='tempest-TestServerVolumeAttachmentScenario-server-1549556685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1549556685',id=34,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPfvzfeEFewBlZeLUkdDgkVwcJ8p2J2CeB9CzQ3/PqGNNDRZAl5ElQLUz4KUFZIKTXky3dEqPgkxHHHSAi+ArOHxs8VlRojZxv1X/nMopru4Ey6LCkmsrvxjUhyGB/FdA==',key_name='tempest-keypair-1001599202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa189dfa33b24dd9b7fbaeb2bdd59e2d',ramdisk_id='',reservation_id='r-nnidpssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1700496772',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1700496772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457daf84e75945a1acf6662e94ee7299',uuid=b0de1887-6095-4062-a882-6240e5231313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converting VIF {"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG os_vif [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd300d53-0994-5005-9337-b1b70f64bac9', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff9b0fcd-07, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff9b0fcd-07, col_values=(('qos', UUID('afaadc5f-5c6a-4a40-a19a-bd77abde3f70')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff9b0fcd-07, col_values=(('external_ids', {'iface-id': 'ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b9:eb', 'vm-uuid': 'b0de1887-6095-4062-a882-6240e5231313'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:29 user nova-compute[75279]: INFO os_vif [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07')
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No VIF found with MAC fa:16:3e:08:b9:eb, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Updated VIF entry in instance network info cache for port ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating instance_info_cache with network_info: [{"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:19:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-164a7d2b-48c7-46e6-8f5b-7b28a1afdfdf req-95175457-7e36-4b95-87bc-83ec24fa0433 service nova] Releasing lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:31 user nova-compute[75279]: WARNING nova.compute.manager [req-c1b4a58f-4ec3-41d8-b543-2b796f69af3c req-1d2de5d6-b606-4b61-a71b-2bd632b53e8f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state building and task_state spawning.
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.compute.manager [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:19:33 user nova-compute[75279]: WARNING nova.compute.manager [req-964ca535-8f5a-44b0-90cb-1028138daa52 req-e27c5108-19ca-4c45-91bd-7dafe431f50b service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state building and task_state spawning.
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:19:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b0de1887-6095-4062-a882-6240e5231313] Instance spawned successfully.
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:19:33 user nova-compute[75279]: INFO nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 11 00:19:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:19:33 user nova-compute[75279]: INFO nova.compute.manager [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Took 7.89 seconds to build instance.
Nov 11 00:19:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b793fc1-a29d-4719-824c-cd741ab6397a tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.028s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:34 user nova-compute[75279]: INFO nova.compute.manager [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Attaching volume 1edd6260-1864-4269-b764-cf215c485337 to /dev/vdb
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.utils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e3cc8f-3c63-4d9c-aa71-78680610bb58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[08207f61-fcab-4d2a-9631-d9c35004d44f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d615533-d233-4c4a-a552-eaecd6dd4c90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d5696-a53b-4879-a121-9c654af2b9d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:19:34 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:19:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[166245a1-d619-4347-9e8a-d5b878436db0]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG os_brick.utils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:19:34 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updating existing volume attachment record: f8b65f06-e66c-416f-8dc9-044e04f6776b {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCWSVnAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:19:36 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:19:36 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:19:36 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7523a972-eabe-4ebb-b4dd-ee4b11b34207]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:19:36 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4335c-8cdd-4a45-a333-cba626b9b812]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655] added
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f50f1d4-b756-480a-ba41-5b1ee71aa78d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad37206-8da1-4e82-937f-ded756732917]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCWSVnAc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCWSVnAc" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01cdda4-68a8-417d-9f5f-44af7b900e6c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lCWSVnAc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc59a0-a7e3-45af-a01e-f271b5dd296e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6621e6d0-23e4-4e2c-9a67-7dfb6dcadcdd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc16bb4-be6b-4f02-8be7-28e49e0ab3dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260]
Nov 11 00:19:36 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260] successful.
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6d3497-ad03-4229-b7e8-de6cbac4cfdc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b77e8-7d50-421e-9139-be0abb5f3e09]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:19:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f5ff3-d492-4685-8a0a-1599bb757cfb]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:19:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCWSVnAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23739653039373535', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739653039373535', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG nova.objects.instance [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:19:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:19:37 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:19:37 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:19:37 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:19:37 user nova-compute[75279]:   <serial>39bd9609-791e-4551-9ccf-e0b97481b655</serial>
Nov 11 00:19:37 user nova-compute[75279]: </disk>
Nov 11 00:19:37 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No VIF found with MAC fa:16:3e:18:d9:aa, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-21b2c230-292c-4bba-9c62-d522e97585ac tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.873s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:39 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:19:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:42 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:42 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=25.112037658691406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c6e1b6b4-8688-4d28-b8e0-6828053720f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a32bd458-ae96-447d-8b49-fdbee548ef3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b0de1887-6095-4062-a882-6240e5231313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:19:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:19:43 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:19:43 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:19:43 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:19:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:19:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:19:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:19:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: INFO nova.compute.manager [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Terminating instance
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_requests' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'numa_topology' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:20:04 user nova-compute[75279]: INFO nova.compute.claims [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Claim successful on node user
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-ef50915d-b7cd-4031-af70-9f456dae12ea req-b20908a6-cc20-42f9-95be-6f8186d472d3 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-unplugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:20:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Instance destroyed successfully.
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'resources' on Instance uuid c6e1b6b4-8688-4d28-b8e0-6828053720f1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1762044897',display_name='tempest-ServerActionsTestOtherA-server-1762044897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1762044897',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-n8skr4m7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=c6e1b6b4-8688-4d28-b8e0-6828053720f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "71c32096-1127-4b3b-b506-b52ae75f2951", "address": "fa:16:3e:72:db:2e", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c32096-11", "ovs_interfaceid": "71c32096-1127-4b3b-b506-b52ae75f2951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_vif [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71c32096-11, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eaeede8a-4c74-4379-83f8-ed1e1da9e663) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:05 user nova-compute[75279]: INFO os_vif [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:db:2e,bridge_name='br-int',has_traffic_filtering=True,id=71c32096-1127-4b3b-b506-b52ae75f2951,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c32096-11')
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxqZhPDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:05 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d84b86-fb47-4fc4-abf0-51a7f55a0ed6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:20:05 user nova-compute[75279]: No targets found.
Nov 11 00:20:05 user nova-compute[75279]: iSNS:
Nov 11 00:20:05 user nova-compute[75279]: No targets found.
Nov 11 00:20:05 user nova-compute[75279]: STATIC:
Nov 11 00:20:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:20:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655
Nov 11 00:20:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8
Nov 11 00:20:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:05 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:20:05 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:05 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:05 user nova-compute[75279]: FIRMWARE:
Nov 11 00:20:05 user nova-compute[75279]: No targets found.
Nov 11 00:20:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:20:05 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:20:05 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a5cb7-5882-42c5-ae9f-c26696e55377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab177e-cddf-4484-b7c2-2f29955a005b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0222320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d3bf52-47f3-43ef-9542-2cbbc60ea75f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f798b513-be0e-4a20-bde0-c1b554edb105]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd9882-7d4c-4614-93ce-b4c32282b08e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[89355312-74f0-4014-b88a-ed416d50013f]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb1f5d118-6b1fbcbececc24ef', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b1f5d118', '/dev/disk/by-id/scsi-23662316662636265') {{(pid=86651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9278c20a-5ece-4943-bad2-7eb185b4c781]: (4, None) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f3b2b2-55d2-4212-bfba-2e74a9b5faf4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b415e7-c042-4a20-a01c-08bad5530e00]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260]
Nov 11 00:20:05 user nova-compute[75279]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8, portal: 172.16.0.220,3260] successful.
Nov 11 00:20:05 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:05 user nova-compute[75279]: INFO nova.network.neutron [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating port 1a9abbe9-245a-4d04-8126-92f12a5b6125 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd475a1e-79de-4ff4-8efb-0b5c900998c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cec1845-8b94-42c4-8f63-76058d4b64ec]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] <== disconnect_volume: return (376ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:20:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Deleting instance files /opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1_del
Nov 11 00:20:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Deletion of /opt/stack/data/nova/instances/c6e1b6b4-8688-4d28-b8e0-6828053720f1_del complete
Nov 11 00:20:05 user nova-compute[75279]: INFO nova.compute.manager [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 11 00:20:05 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:20:05 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing instance network info cache due to event network-changed-1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] Acquiring lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:06 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Took 1.25 seconds to deallocate network for instance.
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] Acquiring lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] No waiting events found dispatching network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:06 user nova-compute[75279]: WARNING nova.compute.manager [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received unexpected event network-vif-plugged-71c32096-1127-4b3b-b506-b52ae75f2951 for instance with vm_state active and task_state deleting.
Nov 11 00:20:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-21c86a31-ce7d-4221-a786-b95acbbc09ba req-b1c08133-2a38-41c3-b9c5-12e03b947e43 service nova] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Received event network-vif-deleted-71c32096-1127-4b3b-b506-b52ae75f2951 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:20:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Creating image(s)
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] Acquired lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG nova.network.neutron [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Refreshing network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG nova.objects.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<c2c05958-0016-4d89-9d1a-0c593b761ab1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "f3818c675dadf1a34802b4ca635759e7444b816d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "f3818c675dadf1a34802b4ca635759e7444b816d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:08 user nova-compute[75279]: INFO nova.compute.manager [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Took 1.45 seconds to detach 1 volumes for instance.
Nov 11 00:20:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: c6e1b6b4-8688-4d28-b8e0-6828053720f1] Deleting volume: cd475a1e-79de-4ff4-8efb-0b5c900998c8 {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG nova.virt.images [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] c2e172af-4622-48ec-bb51-19a018cd547b was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.part /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG nova.network.neutron [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updated VIF entry in instance network info cache for port 1a9abbe9-245a-4d04-8126-92f12a5b6125. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG nova.network.neutron [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e0b98988-05c1-44be-8303-657f764c8fa8 req-53d26c0f-ef4f-41f3-bafb-b9b1fa96eccd service nova] Releasing lock "refresh_cache-c2c05958-0016-4d89-9d1a-0c593b761ab1" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.part /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.converted" returned: 0 in 0.411s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "f3818c675dadf1a34802b4ca635759e7444b816d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.932s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:09 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Deleted allocations for instance c6e1b6b4-8688-4d28-b8e0-6828053720f1
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "f3818c675dadf1a34802b4ca635759e7444b816d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "f3818c675dadf1a34802b4ca635759e7444b816d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-65a27fff-b9c3-4eea-b277-c9d17a108737 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "c6e1b6b4-8688-4d28-b8e0-6828053720f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.242s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d,backing_fmt=raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d,backing_fmt=raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk 1073741824" returned: 0 in 0.052s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "f3818c675dadf1a34802b4ca635759e7444b816d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'migration_context' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:09 user nova-compute[75279]: DEBUG nova.objects.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<c2c05958-0016-4d89-9d1a-0c593b761ab1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Rebasing disk image.
Nov 11 00:20:09 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a -F raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a -F raw /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk" returned: 0 in 2.870s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Ensure instance console log exists: /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start _get_guest_xml network_info=[{"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a4fdbaca33696fc6ddd1d5983164282c',container_format='bare',created_at=2023-11-11T00:17:30Z,direct_url=<?>,disk_format='qcow2',id=c2e172af-4622-48ec-bb51-19a018cd547b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2127045035-shelved',owner='ae778b46b71f4d1db8fce5694256ebb9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:17:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOANTklD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c2c05958-0016-4d89-9d1a-0c593b761ab1', 'attached_at': '', 'detached_at': '', 'volume_id': '49c3f383-dd82-4319-bbed-bcfc5df7725d', 'serial': '49c3f383-dd82-4319-bbed-bcfc5df7725d'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'boot_index': None, 'attachment_id': '289ebaac-6610-4467-a63f-10554db51d4d', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:20:12 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:12 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a4fdbaca33696fc6ddd1d5983164282c',container_format='bare',created_at=2023-11-11T00:17:30Z,direct_url=<?>,disk_format='qcow2',id=c2e172af-4622-48ec-bb51-19a018cd547b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2127045035-shelved',owner='ae778b46b71f4d1db8fce5694256ebb9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:17:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:12 user nova-compute[75279]: DEBUG nova.objects.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<c2c05958-0016-4d89-9d1a-0c593b761ab1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOANTklD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:13 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5611c-1240-4dba-bfed-26f6831e03f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:20:13 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2000729f-079c-45fc-b218-2bc82710e04a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d] added
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711852d-b2e3-4627-847e-ca8278b3b5a6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6e304-ba3e-4108-bb4d-0eb22db74864]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOANTklD {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOANTklD" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214f28f-ce2b-47f8-abe0-19d02b6c6321]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOANTklD'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[59345b4e-5bc7-4cc0-ba8f-6e17a7026e97]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0c0ef-06f5-45b5-aa84-f2fe87b39fcb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[13996f9e-3dda-4540-8648-4916cf61fd41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260]
Nov 11 00:20:13 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260] successful.
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c8678-4b85-483a-ab89-aee3fa51048a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a94fa49-0136-4316-b646-a00b1da77a95]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:13 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d0db49-b481-40db-9f11-1ce2c5124920]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:20:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOANTklD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23539383463646363', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539383463646363', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='c2e172af-4622-48ec-bb51-19a018cd547b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-58678597',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:17:34.597382',shelved_host='user',shelved_image_id='c2e172af-4622-48ec-bb51-19a018cd547b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_devices' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.objects.base [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<c2c05958-0016-4d89-9d1a-0c593b761ab1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:20:14 user nova-compute[75279]:   <uuid>c2c05958-0016-4d89-9d1a-0c593b761ab1</uuid>
Nov 11 00:20:14 user nova-compute[75279]:   <name>instance-0000001c</name>
Nov 11 00:20:14 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:20:14 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:20:14 user nova-compute[75279]:   <metadata>
Nov 11 00:20:14 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:20:14 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2127045035</nova:name>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:20:12</nova:creationTime>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:20:14 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:20:14 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:owner>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:user uuid="93f7498f8558443eab6afb03331bc6aa">tempest-AttachVolumeShelveTestJSON-174044347-project-member</nova:user>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:project uuid="ae778b46b71f4d1db8fce5694256ebb9">tempest-AttachVolumeShelveTestJSON-174044347</nova:project>
Nov 11 00:20:14 user nova-compute[75279]:       </nova:owner>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:root type="image" uuid="c2e172af-4622-48ec-bb51-19a018cd547b"/>
Nov 11 00:20:14 user nova-compute[75279]:       <nova:ports>
Nov 11 00:20:14 user nova-compute[75279]:         <nova:port uuid="1a9abbe9-245a-4d04-8126-92f12a5b6125">
Nov 11 00:20:14 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:20:14 user nova-compute[75279]:         </nova:port>
Nov 11 00:20:14 user nova-compute[75279]:       </nova:ports>
Nov 11 00:20:14 user nova-compute[75279]:     </nova:instance>
Nov 11 00:20:14 user nova-compute[75279]:   </metadata>
Nov 11 00:20:14 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:20:14 user nova-compute[75279]:     <system>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="serial">c2c05958-0016-4d89-9d1a-0c593b761ab1</entry>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="uuid">c2c05958-0016-4d89-9d1a-0c593b761ab1</entry>
Nov 11 00:20:14 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:20:14 user nova-compute[75279]:     </system>
Nov 11 00:20:14 user nova-compute[75279]:   </sysinfo>
Nov 11 00:20:14 user nova-compute[75279]:   <os>
Nov 11 00:20:14 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:20:14 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:20:14 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:20:14 user nova-compute[75279]:   </os>
Nov 11 00:20:14 user nova-compute[75279]:   <features>
Nov 11 00:20:14 user nova-compute[75279]:     <acpi/>
Nov 11 00:20:14 user nova-compute[75279]:     <apic/>
Nov 11 00:20:14 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:20:14 user nova-compute[75279]:   </features>
Nov 11 00:20:14 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:20:14 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:20:14 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:20:14 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:20:14 user nova-compute[75279]:   </clock>
Nov 11 00:20:14 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:20:14 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:20:14 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:20:14 user nova-compute[75279]:   </cpu>
Nov 11 00:20:14 user nova-compute[75279]:   <devices>
Nov 11 00:20:14 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:20:14 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:20:14 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk"/>
Nov 11 00:20:14 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:20:14 user nova-compute[75279]:     </disk>
Nov 11 00:20:14 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:20:14 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:14 user nova-compute[75279]:       <source dev="/dev/sdd"/>
Nov 11 00:20:14 user nova-compute[75279]:       <target dev="vdc" bus="virtio"/>
Nov 11 00:20:14 user nova-compute[75279]:       <serial>49c3f383-dd82-4319-bbed-bcfc5df7725d</serial>
Nov 11 00:20:14 user nova-compute[75279]:     </disk>
Nov 11 00:20:14 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:20:14 user nova-compute[75279]:       <mac address="fa:16:3e:99:66:2a"/>
Nov 11 00:20:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:14 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:20:14 user nova-compute[75279]:       <target dev="tap1a9abbe9-24"/>
Nov 11 00:20:14 user nova-compute[75279]:     </interface>
Nov 11 00:20:14 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:20:14 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/console.log" append="off"/>
Nov 11 00:20:14 user nova-compute[75279]:     </serial>
Nov 11 00:20:14 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:20:14 user nova-compute[75279]:     <video>
Nov 11 00:20:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:14 user nova-compute[75279]:     </video>
Nov 11 00:20:14 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:20:14 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:20:14 user nova-compute[75279]:     </rng>
Nov 11 00:20:14 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:20:14 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:20:14 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:20:14 user nova-compute[75279]:     </memballoon>
Nov 11 00:20:14 user nova-compute[75279]:   </devices>
Nov 11 00:20:14 user nova-compute[75279]: </domain>
Nov 11 00:20:14 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='c2e172af-4622-48ec-bb51-19a018cd547b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-58678597',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:17:34.597382',shelved_host='user',shelved_image_id='c2e172af-4622-48ec-bb51-19a018cd547b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG os_vif [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ec6d90d-e921-50f1-acd4-43880aebf70b', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9abbe9-24, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a9abbe9-24, col_values=(('qos', UUID('44dae2d2-81b4-4cfb-be6b-c37a150c0129')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a9abbe9-24, col_values=(('external_ids', {'iface-id': '1a9abbe9-245a-4d04-8126-92f12a5b6125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:66:2a', 'vm-uuid': 'c2c05958-0016-4d89-9d1a-0c593b761ab1'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:14 user nova-compute[75279]: INFO os_vif [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24')
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No VIF found with MAC fa:16:3e:99:66:2a, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:16 user nova-compute[75279]: WARNING nova.compute.manager [req-f31a51b7-ed98-4d9c-b21a-b96fc99d061a req-e109c73f-1294-4103-a258-a0962a605503 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 00:20:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:18 user nova-compute[75279]: WARNING nova.compute.manager [req-99042df1-c7b4-43a6-b123-411bfbb7ca9a req-d51bbb35-e41a-4dca-bab6-5eed6eb48496 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 00:20:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:20:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:20:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance spawned successfully.
Nov 11 00:20:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1859b487-1ac0-4910-aa52-c955e0659bb9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 56.156s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmjUAWNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:19 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:19 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:19 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[436236bf-6e93-43d2-bd57-828d99c9667f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:20:19 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1219df-9268-4adf-b01a-1a1503cc880e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337] added
Nov 11 00:20:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab07b5b-eaa8-4970-9f9f-db54ea9ec96d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[02233845-a4a5-4cdb-b95f-3755929251d6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmjUAWNg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmjUAWNg" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0539b6d-1b6f-4e19-9b10-6b3f7b157c1c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nmjUAWNg'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d02df7-1eb1-44b9-95ba-568c9ab5a0d6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1191e7a9-8f29-4d30-bc26-dd266cc9285b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:19 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --login" returned: 0 in 0.243s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[271d53c8-cac5-467c-be77-7cf28919f235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260]
Nov 11 00:20:20 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260] successful.
Nov 11 00:20:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cdaf4-183a-45c5-8ae5-7e94cf1aad7f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[423064b4-7d6f-4e71-ad1e-8f3e6ba3318b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:20 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.504s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3320cf-97ea-43f6-a522-c2157b20a84d]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:20:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmjUAWNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.554s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== connect_volume: return (1556ms) {'type': 'block', 'scsi_wwn': '23538336538386461', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538336538386461', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:20:21 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:21 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:20:21 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:20:21 user nova-compute[75279]:   <serial>1edd6260-1864-4269-b764-cf215c485337</serial>
Nov 11 00:20:21 user nova-compute[75279]: </disk>
Nov 11 00:20:21 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] No VIF found with MAC fa:16:3e:ae:22:7b, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:20:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c7323a39-f20f-482a-8d86-dda530c2f823 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.662s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:23 user nova-compute[75279]: INFO nova.compute.manager [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Detaching volume 1edd6260-1864-4269-b764-cf215c485337
Nov 11 00:20:23 user nova-compute[75279]: INFO nova.virt.block_device [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Attempting to driver detach volume 1edd6260-1864-4269-b764-cf215c485337 from mountpoint /dev/vdb
Nov 11 00:20:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Attempting to detach device vdb from instance a32bd458-ae96-447d-8b49-fdbee548ef3f from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:20:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:20:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:23 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:20:23 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:20:23 user nova-compute[75279]:   <serial>1edd6260-1864-4269-b764-cf215c485337</serial>
Nov 11 00:20:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:20:23 user nova-compute[75279]: </disk>
Nov 11 00:20:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:20:23 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance a32bd458-ae96-447d-8b49-fdbee548ef3f from the persistent domain config.
Nov 11 00:20:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a32bd458-ae96-447d-8b49-fdbee548ef3f from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:20:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:20:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:23 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:20:23 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:20:23 user nova-compute[75279]:   <serial>1edd6260-1864-4269-b764-cf215c485337</serial>
Nov 11 00:20:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:20:23 user nova-compute[75279]: </disk>
Nov 11 00:20:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:20:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:20:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:27 user nova-compute[75279]: INFO nova.compute.manager [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Detaching volume 39bd9609-791e-4551-9ccf-e0b97481b655
Nov 11 00:20:28 user nova-compute[75279]: INFO nova.virt.block_device [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attempting to driver detach volume 39bd9609-791e-4551-9ccf-e0b97481b655 from mountpoint /dev/vdb
Nov 11 00:20:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Attempting to detach device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:20:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:20:28 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:28 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:20:28 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:20:28 user nova-compute[75279]:   <serial>39bd9609-791e-4551-9ccf-e0b97481b655</serial>
Nov 11 00:20:28 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:20:28 user nova-compute[75279]: </disk>
Nov 11 00:20:28 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:20:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config.
Nov 11 00:20:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:20:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:20:28 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:28 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:20:28 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:20:28 user nova-compute[75279]:   <serial>39bd9609-791e-4551-9ccf-e0b97481b655</serial>
Nov 11 00:20:28 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:20:28 user nova-compute[75279]: </disk>
Nov 11 00:20:28 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:20:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:20:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:33 user nova-compute[75279]: INFO nova.compute.manager [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Rescuing
Nov 11 00:20:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:20:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:34 user nova-compute[75279]: WARNING nova.compute.manager [req-091ae18c-1890-493c-a704-e804fa32085d req-73f8bf85-68b9-47cb-a3ca-2bbea45b9d37 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state active and task_state rescuing.
Nov 11 00:20:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance destroyed successfully.
Nov 11 00:20:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Attempting a stable device rescue
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75279) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:20:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Creating image(s)
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG nova.virt.images [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] 3f281339-d303-4312-990e-a0fc58f269d2 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:20:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.part /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.part /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.converted" returned: 0 in 0.400s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:36 user nova-compute[75279]: WARNING nova.compute.manager [req-ab56c33a-bcfb-4cd0-8cdc-64b0ee45b633 req-2056b364-dcb7-4f4a-8a2a-b4b45efdc8b9 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state active and task_state rescuing.
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.602s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c,backing_fmt=raw /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c,backing_fmt=raw /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue" returned: 0 in 0.048s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "4ba569a380ca49027e8c7f5d33dc74eebb44152c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'migration_context' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<8f4c4be6-988e-4769-84f6-cead8adf4d07> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start _get_guest_xml network_info=[{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:ce:8b:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3f281339-d303-4312-990e-a0fc58f269d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8f4c4be6-988e-4769-84f6-cead8adf4d07', 'attached_at': '', 'detached_at': '', 'volume_id': '5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'serial': '5df5ab7e-102d-4438-8dba-f68e86bb3eb6'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1f99a3d2-d522-4aaf-bc69-43daf7c1551e', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<8f4c4be6-988e-4769-84f6-cead8adf4d07> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'numa_topology' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<8f4c4be6-988e-4769-84f6-cead8adf4d07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:36 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<8f4c4be6-988e-4769-84f6-cead8adf4d07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:36 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:36 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:36 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[902315a3-d0bc-4563-a42f-e06e1d5d09f0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PbcqlWhV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 11 00:20:36 user nova-compute[75279]: node.name = iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:20:36 user nova-compute[75279]: node.tpgt = -1
Nov 11 00:20:36 user nova-compute[75279]: node.startup = automatic
Nov 11 00:20:36 user nova-compute[75279]: node.leading_login = No
Nov 11 00:20:36 user nova-compute[75279]: iface.iscsi_ifacename = default
Nov 11 00:20:36 user nova-compute[75279]: iface.net_ifacename = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.ipaddress = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.prefix_len = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.hwaddress = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.transport_name = tcp
Nov 11 00:20:36 user nova-compute[75279]: iface.initiatorname = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.vlan_id = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.vlan_priority = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.vlan_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.iface_num = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.mtu = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.port = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.bootproto = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.subnet_mask = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.gateway = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_alt_client_id_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_alt_client_id = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_dns = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_learn_iqn = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_req_vendor_id_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_vendor_id_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_vendor_id = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.dhcp_slp_da = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.fragmentation = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.gratuitous_arp = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.incoming_forwarding = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.tos_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.tos = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.ttl = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.delayed_ack = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.tcp_nagle = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.tcp_wsf_state = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.tcp_wsf = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.tcp_timer_scale = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.tcp_timestamp = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.redirect = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.def_task_mgmt_timeout = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.header_digest = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.data_digest = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.immediate_data = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.initial_r2t = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.data_seq_inorder = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.data_pdu_inorder = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.erl = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.max_receive_data_len = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.first_burst_len = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.max_outstanding_r2t = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.max_burst_len = 0
Nov 11 00:20:36 user nova-compute[75279]: iface.chap_auth = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.bidi_chap = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.strict_login_compliance = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.discovery_auth = <empty>
Nov 11 00:20:36 user nova-compute[75279]: iface.discovery_logout = <empty>
Nov 11 00:20:36 user nova-compute[75279]: node.discovery_address = <empty>
Nov 11 00:20:36 user nova-compute[75279]: node.discovery_port = 0
Nov 11 00:20:36 user nova-compute[75279]: node.discovery_type = static
Nov 11 00:20:36 user nova-compute[75279]: node.session.initial_cmdsn = 0
Nov 11 00:20:36 user nova-compute[75279]: node.session.initial_login_retry_max = 8
Nov 11 00:20:36 user nova-compute[75279]: node.session.xmit_thread_priority = -20
Nov 11 00:20:36 user nova-compute[75279]: node.session.cmds_max = 128
Nov 11 00:20:36 user nova-compute[75279]: node.session.queue_depth = 32
Nov 11 00:20:36 user nova-compute[75279]: node.session.nr_sessions = 1
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.authmethod = CHAP
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.username = PbcqlWhV
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.password = ***
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.username_in = <empty>
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.password_in = <empty>
Nov 11 00:20:36 user nova-compute[75279]: node.session.auth.chap_algs = MD5
Nov 11 00:20:36 user nova-compute[75279]: node.session.timeo.replacement_timeout = 120
Nov 11 00:20:36 user nova-compute[75279]: node.session.err_timeo.abort_timeout = 15
Nov 11 00:20:36 user nova-compute[75279]: node.session.err_timeo.lu_reset_timeout = 30
Nov 11 00:20:36 user nova-compute[75279]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 11 00:20:36 user nova-compute[75279]: node.session.err_timeo.host_reset_timeout = 60
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.FastAbort = Yes
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.InitialR2T = No
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.ImmediateData = Yes
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.FirstBurstLength = 262144
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.MaxBurstLength = 16776192
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.DefaultTime2Retain = 0
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.DefaultTime2Wait = 2
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.MaxConnections = 1
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 11 00:20:36 user nova-compute[75279]: node.session.iscsi.ERL = 0
Nov 11 00:20:36 user nova-compute[75279]: node.session.scan = manual
Nov 11 00:20:36 user nova-compute[75279]: node.session.reopen_max = 0
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].address = 172.16.0.220
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].port = 3260
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].startup = manual
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].tcp.window_size = 524288
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].tcp.type_of_service = 0
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].timeo.logout_timeout = 15
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].timeo.login_timeout = 15
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].timeo.auth_timeout = 45
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].timeo.noop_out_interval = 5
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].timeo.noop_out_timeout = 5
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.HeaderDigest = None
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.DataDigest = None
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.IFMarker = No
Nov 11 00:20:36 user nova-compute[75279]: node.conn[0].iscsi.OFMarker = No
Nov 11 00:20:36 user nova-compute[75279]: # END RECORD
Nov 11 00:20:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56217661-c04e-4256-b12f-85ad0d1febb5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[664aaf87-480f-43ed-8ac5-52a434bacf63]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbcqlWhV {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbcqlWhV" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976ace3-7754-4e82-a478-4480920576c3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbcqlWhV'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbbf88-5ea2-416e-b949-7abf01c1eeab]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83a5a1-1061-43b7-bee6-89c96bb1592b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:36 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] HCTL ('33', '0', '0', 0) found on session 34 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c125a6-e34f-49a1-a4d7-9230eb53321e]: (4, ('0 0 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Searching for a device in session 34 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23532373139623332', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532373139623332', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536087322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536087322',id=32,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:19:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-4294y3j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:19:04Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=8f4c4be6-988e-4769-84f6-cead8adf4d07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:ce:8b:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "vif_mac": "fa:16:3e:ce:8b:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Object Instance<8f4c4be6-988e-4769-84f6-cead8adf4d07> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:20:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:20:36 user nova-compute[75279]:   <uuid>8f4c4be6-988e-4769-84f6-cead8adf4d07</uuid>
Nov 11 00:20:36 user nova-compute[75279]:   <name>instance-00000020</name>
Nov 11 00:20:36 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:20:36 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:20:36 user nova-compute[75279]:   <metadata>
Nov 11 00:20:36 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:20:36 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1536087322</nova:name>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:20:36</nova:creationTime>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:20:36 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:20:36 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:owner>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:user uuid="223cf2dd1ecd4a12a5db181391692422">tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member</nova:user>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:project uuid="5707b16ebb6042e08f11590de3c92bca">tempest-ServerBootFromVolumeStableRescueTest-319780688</nova:project>
Nov 11 00:20:36 user nova-compute[75279]:       </nova:owner>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:20:36 user nova-compute[75279]:       <nova:ports>
Nov 11 00:20:36 user nova-compute[75279]:         <nova:port uuid="05814dbb-1e90-40a2-87cd-647c87a46e86">
Nov 11 00:20:36 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 00:20:36 user nova-compute[75279]:         </nova:port>
Nov 11 00:20:36 user nova-compute[75279]:       </nova:ports>
Nov 11 00:20:36 user nova-compute[75279]:     </nova:instance>
Nov 11 00:20:36 user nova-compute[75279]:   </metadata>
Nov 11 00:20:36 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:20:36 user nova-compute[75279]:     <system>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="serial">8f4c4be6-988e-4769-84f6-cead8adf4d07</entry>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="uuid">8f4c4be6-988e-4769-84f6-cead8adf4d07</entry>
Nov 11 00:20:36 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:20:36 user nova-compute[75279]:     </system>
Nov 11 00:20:36 user nova-compute[75279]:   </sysinfo>
Nov 11 00:20:36 user nova-compute[75279]:   <os>
Nov 11 00:20:36 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:20:36 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:20:36 user nova-compute[75279]:   </os>
Nov 11 00:20:36 user nova-compute[75279]:   <features>
Nov 11 00:20:36 user nova-compute[75279]:     <acpi/>
Nov 11 00:20:36 user nova-compute[75279]:     <apic/>
Nov 11 00:20:36 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:20:36 user nova-compute[75279]:   </features>
Nov 11 00:20:36 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:20:36 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:20:36 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:20:36 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:20:36 user nova-compute[75279]:   </clock>
Nov 11 00:20:36 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:20:36 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:20:36 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:20:36 user nova-compute[75279]:   </cpu>
Nov 11 00:20:36 user nova-compute[75279]:   <devices>
Nov 11 00:20:36 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:20:36 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:20:36 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:20:36 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:20:36 user nova-compute[75279]:       <serial>5df5ab7e-102d-4438-8dba-f68e86bb3eb6</serial>
Nov 11 00:20:36 user nova-compute[75279]:     </disk>
Nov 11 00:20:36 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:20:36 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:20:36 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue"/>
Nov 11 00:20:36 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:20:36 user nova-compute[75279]:       <boot order="1"/>
Nov 11 00:20:36 user nova-compute[75279]:     </disk>
Nov 11 00:20:36 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:20:36 user nova-compute[75279]:       <mac address="fa:16:3e:ce:8b:71"/>
Nov 11 00:20:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:36 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:20:36 user nova-compute[75279]:       <target dev="tap05814dbb-1e"/>
Nov 11 00:20:36 user nova-compute[75279]:     </interface>
Nov 11 00:20:36 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:20:36 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/console.log" append="off"/>
Nov 11 00:20:36 user nova-compute[75279]:     </serial>
Nov 11 00:20:36 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:20:36 user nova-compute[75279]:     <video>
Nov 11 00:20:36 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:36 user nova-compute[75279]:     </video>
Nov 11 00:20:36 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:20:36 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:20:36 user nova-compute[75279]:     </rng>
Nov 11 00:20:36 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:20:36 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:20:36 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:20:36 user nova-compute[75279]:     </memballoon>
Nov 11 00:20:36 user nova-compute[75279]:   </devices>
Nov 11 00:20:36 user nova-compute[75279]: </domain>
Nov 11 00:20:36 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:20:37 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance destroyed successfully.
Nov 11 00:20:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] No VIF found with MAC fa:16:3e:ce:8b:71, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:20:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:38 user nova-compute[75279]: WARNING nova.compute.manager [req-29980bb0-8645-43c5-bdaf-50b627599a04 req-82760c10-3175-4f6f-b538-60fb162372e7 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state active and task_state rescuing.
Nov 11 00:20:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a0f33da4-50cd-44fa-87bb-e7dd664aacc9 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:40 user nova-compute[75279]: WARNING nova.compute.manager [req-12b84477-0636-46b8-afa0-95a6fef3dd09 req-152a92f3-eee2-4154-8038-7a32e8333b36 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state rescued and task_state None.
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a32bd458-ae96-447d-8b49-fdbee548ef3f is timed out.
Nov 11 00:20:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully detached device vdb from instance a32bd458-ae96-447d-8b49-fdbee548ef3f from the live domain config.
Nov 11 00:20:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmjUAWNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:44 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057bc7e-2a5a-4991-a4c6-005284c5d0dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:20:44 user nova-compute[75279]: No targets found.
Nov 11 00:20:44 user nova-compute[75279]: iSNS:
Nov 11 00:20:44 user nova-compute[75279]: No targets found.
Nov 11 00:20:44 user nova-compute[75279]: STATIC:
Nov 11 00:20:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337
Nov 11 00:20:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d
Nov 11 00:20:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:20:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655
Nov 11 00:20:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:20:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:44 user nova-compute[75279]: FIRMWARE:
Nov 11 00:20:44 user nova-compute[75279]: No targets found.
Nov 11 00:20:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:20:44 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:20:44 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38520a3-fe7e-431e-aab6-8b9ddb561540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc961c2-c69d-47e0-bd9a-a9a4a1b3ccb7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:44 user nova-compute[75279]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 (non-flash)
Nov 11 00:20:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f8317ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346ec70-a0ff-4d18-802e-33b4d69770e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[04953f4c-722c-4d75-88eb-893372e0f71b]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb2034-210c-4b09-a9ce-bfad5ca4711c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e2111-b204-4e0c-b6c6-fe07d370967a]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ff80c-b97b-4ef9-8802-05d981050b6c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb723909-d2ba-48fa-b489-543ea4f8b245]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260]
Nov 11 00:20:44 user nova-compute[75279]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337, portal: 172.16.0.220,3260] successful.
Nov 11 00:20:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edd6260-1864-4269-b764-cf215c485337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b249a5f-2d76-473d-b633-299aa3dedbdd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] <== disconnect_volume: return (429ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:45 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:45 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=24.92410659790039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a32bd458-ae96-447d-8b49-fdbee548ef3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b0de1887-6095-4062-a882-6240e5231313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'flavor' on Instance uuid a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-97bc8d08-cf5a-4b47-9a3a-5ec351f2cca3 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.403s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:20:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 9e720d48-0c0f-4fe6-b778-e5568e97eabf {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [{"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-9e720d48-0c0f-4fe6-b778-e5568e97eabf" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:20:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b is timed out.
Nov 11 00:20:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config.
Nov 11 00:20:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCWSVnAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:20:48 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[64713c59-399a-4acb-9d0a-5a13ffed8c7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:20:48 user nova-compute[75279]: No targets found.
Nov 11 00:20:48 user nova-compute[75279]: iSNS:
Nov 11 00:20:48 user nova-compute[75279]: No targets found.
Nov 11 00:20:48 user nova-compute[75279]: STATIC:
Nov 11 00:20:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d
Nov 11 00:20:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:20:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655
Nov 11 00:20:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:20:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:20:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:20:48 user nova-compute[75279]: FIRMWARE:
Nov 11 00:20:48 user nova-compute[75279]: No targets found.
Nov 11 00:20:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:20:48 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:20:48 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a2596-305e-4b99-9cb2-4863afa431e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f39cc-a14f-461c-845d-02746a81f5cf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 (non-flash)
Nov 11 00:20:48 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:20:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03d6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fa6f9-4ed7-492d-9b2c-f15206a98d3f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bba97f-10d6-4bfa-8f49-10661defd661]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd84f0e-2cdf-4b6c-9f01-23abfcad75f2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4d3b2-7bd7-454b-b5ec-7e8af0e142b0]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ca080-44d3-4fc1-a4ee-5afee96c3829]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd306e8-1f8d-4f0d-a56d-5e4620741518]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260]
Nov 11 00:20:48 user nova-compute[75279]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655, portal: 172.16.0.220,3260] successful.
Nov 11 00:20:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd9609-791e-4551-9ccf-e0b97481b655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757d4b9-09d2-4c96-bde6-b49bf06f0950]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== disconnect_volume: return (354ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:20:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:20:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:49 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b1098aee-19a5-48d3-83d2-09a19558ec7a tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:20:51 user nova-compute[75279]: INFO nova.compute.claims [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Claim successful on node user
Nov 11 00:20:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:20:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:20:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.policy [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ed7eabc3874d63bbeca2213be1c743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24163a6c612c4b8c87a3715b8a57fc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:20:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Creating image(s)
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "ced438f2bc79d3803d2dc46acc7272743940d19d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "ced438f2bc79d3803d2dc46acc7272743940d19d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Successfully created port: 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.virt.images [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] 28f8e6f0-8534-48de-9544-8b942caa05e2 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:20:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.part /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.part /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.converted" returned: 0 in 0.168s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "ced438f2bc79d3803d2dc46acc7272743940d19d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.994s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Successfully updated port: 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "ced438f2bc79d3803d2dc46acc7272743940d19d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "ced438f2bc79d3803d2dc46acc7272743940d19d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d,backing_fmt=raw /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d,backing_fmt=raw /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk 1073741824" returned: 0 in 0.053s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "ced438f2bc79d3803d2dc46acc7272743940d19d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing instance network info cache due to event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance network_info: |[{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:20:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Cannot resize image /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Ensure instance console log exists: /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start _get_guest_xml network_info=[{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T00:20:49Z,direct_url=<?>,disk_format='qcow2',id=28f8e6f0-8534-48de-9544-8b942caa05e2,min_disk=0,min_ram=0,name='tempest-scenario-img--418376099',owner='24163a6c612c4b8c87a3715b8a57fc05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T00:20:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '28f8e6f0-8534-48de-9544-8b942caa05e2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:20:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T00:20:49Z,direct_url=<?>,disk_format='qcow2',id=28f8e6f0-8534-48de-9544-8b942caa05e2,min_disk=0,min_ram=0,name='tempest-scenario-img--418376099',owner='24163a6c612c4b8c87a3715b8a57fc05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T00:20:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:20:52Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:20:54 user nova-compute[75279]:   <uuid>0a975698-e2e3-4f69-ba9f-236659875b4e</uuid>
Nov 11 00:20:54 user nova-compute[75279]:   <name>instance-00000023</name>
Nov 11 00:20:54 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:20:54 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:20:54 user nova-compute[75279]:   <metadata>
Nov 11 00:20:54 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:20:54 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:name>tempest-TestMinimumBasicScenario-server-2020361293</nova:name>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:20:54</nova:creationTime>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:20:54 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:20:54 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:owner>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:user uuid="d7ed7eabc3874d63bbeca2213be1c743">tempest-TestMinimumBasicScenario-978603383-project-member</nova:user>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:project uuid="24163a6c612c4b8c87a3715b8a57fc05">tempest-TestMinimumBasicScenario-978603383</nova:project>
Nov 11 00:20:54 user nova-compute[75279]:       </nova:owner>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:root type="image" uuid="28f8e6f0-8534-48de-9544-8b942caa05e2"/>
Nov 11 00:20:54 user nova-compute[75279]:       <nova:ports>
Nov 11 00:20:54 user nova-compute[75279]:         <nova:port uuid="6c9e5816-01c4-4852-b19e-36cf8238340a">
Nov 11 00:20:54 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 00:20:54 user nova-compute[75279]:         </nova:port>
Nov 11 00:20:54 user nova-compute[75279]:       </nova:ports>
Nov 11 00:20:54 user nova-compute[75279]:     </nova:instance>
Nov 11 00:20:54 user nova-compute[75279]:   </metadata>
Nov 11 00:20:54 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:20:54 user nova-compute[75279]:     <system>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="serial">0a975698-e2e3-4f69-ba9f-236659875b4e</entry>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="uuid">0a975698-e2e3-4f69-ba9f-236659875b4e</entry>
Nov 11 00:20:54 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:20:54 user nova-compute[75279]:     </system>
Nov 11 00:20:54 user nova-compute[75279]:   </sysinfo>
Nov 11 00:20:54 user nova-compute[75279]:   <os>
Nov 11 00:20:54 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:20:54 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:20:54 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:20:54 user nova-compute[75279]:   </os>
Nov 11 00:20:54 user nova-compute[75279]:   <features>
Nov 11 00:20:54 user nova-compute[75279]:     <acpi/>
Nov 11 00:20:54 user nova-compute[75279]:     <apic/>
Nov 11 00:20:54 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:20:54 user nova-compute[75279]:   </features>
Nov 11 00:20:54 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:20:54 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:20:54 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:20:54 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:20:54 user nova-compute[75279]:   </clock>
Nov 11 00:20:54 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:20:54 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:20:54 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:20:54 user nova-compute[75279]:   </cpu>
Nov 11 00:20:54 user nova-compute[75279]:   <devices>
Nov 11 00:20:54 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:20:54 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:20:54 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk"/>
Nov 11 00:20:54 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:20:54 user nova-compute[75279]:     </disk>
Nov 11 00:20:54 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:20:54 user nova-compute[75279]:       <mac address="fa:16:3e:77:61:02"/>
Nov 11 00:20:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:54 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:20:54 user nova-compute[75279]:       <target dev="tap6c9e5816-01"/>
Nov 11 00:20:54 user nova-compute[75279]:     </interface>
Nov 11 00:20:54 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:20:54 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/console.log" append="off"/>
Nov 11 00:20:54 user nova-compute[75279]:     </serial>
Nov 11 00:20:54 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:20:54 user nova-compute[75279]:     <video>
Nov 11 00:20:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:20:54 user nova-compute[75279]:     </video>
Nov 11 00:20:54 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:20:54 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:20:54 user nova-compute[75279]:     </rng>
Nov 11 00:20:54 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:20:54 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:20:54 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:20:54 user nova-compute[75279]:     </memballoon>
Nov 11 00:20:54 user nova-compute[75279]:   </devices>
Nov 11 00:20:54 user nova-compute[75279]: </domain>
Nov 11 00:20:54 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:20:52Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG os_vif [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca3b4c67-88e4-5bb6-97d8-b330661f272b', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9e5816-01, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9e5816-01, col_values=(('qos', UUID('19591901-fd80-437a-83ad-58619b5daa55')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9e5816-01, col_values=(('external_ids', {'iface-id': '6c9e5816-01c4-4852-b19e-36cf8238340a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:61:02', 'vm-uuid': '0a975698-e2e3-4f69-ba9f-236659875b4e'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:54 user nova-compute[75279]: INFO os_vif [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01')
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No VIF found with MAC fa:16:3e:77:61:02, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updated VIF entry in instance network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:20:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b922ee10-55cf-4297-8731-6f5d7c043a9b req-4f0d4032-cbeb-47b5-ad0c-96c889530ad6 service nova] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:55 user nova-compute[75279]: WARNING nova.compute.manager [req-54cb0a72-668e-464c-9645-908946bcb976 req-d0f9ad97-fa97-46c0-878d-35e0feea09d4 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state building and task_state spawning.
Nov 11 00:20:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:20:57 user nova-compute[75279]: WARNING nova.compute.manager [req-74dee53f-6e39-4aaa-8f97-4e0fce6a597d req-be6bce04-7df4-4f6a-b1c1-818d96f86549 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state building and task_state spawning.
Nov 11 00:20:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance spawned successfully.
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:20:58 user nova-compute[75279]: INFO nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 11 00:20:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:20:58 user nova-compute[75279]: INFO nova.compute.manager [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Took 6.62 seconds to build instance.
Nov 11 00:20:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-efabd299-95da-423d-a429-87ec7b2ba193 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:20:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:08 user nova-compute[75279]: INFO nova.compute.manager [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Terminating instance
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-unplugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] No waiting events found dispatching network-vif-unplugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-b9b5db5a-8737-4032-a52d-71c86b15c842 req-ac75c3f8-6c46-4851-9e67-b5e96799ac85 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-unplugged-534db674-6cbc-4e0b-b7fe-25c317603b29 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:21:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Instance destroyed successfully.
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.objects.instance [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lazy-loading 'resources' on Instance uuid 9e720d48-0c0f-4fe6-b778-e5568e97eabf {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1401811801',display_name='tempest-ServerActionsTestOtherA-server-1401811801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1401811801',id=5,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoCmEJwhodiDDqzkzm27qUYjXG0Dl9Ebh9lJFxKffxUwIcfFGLHZf2sgla6hSUw2yDzFdfTkwdOkRsFEiXOCisdbbGFI2Ol/vuTuZ4mD65Hi6vZGoOdVoUuGzGm6WU8MA==',key_name='tempest-keypair-560184654',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e56bb9030efe414aa52c4aa97febfd2e',ramdisk_id='',reservation_id='r-vaym1mfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-191498200',owner_user_name='tempest-ServerActionsTestOtherA-191498200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5de431660e34578b7ef8b6b7e0577ab',uuid=9e720d48-0c0f-4fe6-b778-e5568e97eabf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converting VIF {"id": "534db674-6cbc-4e0b-b7fe-25c317603b29", "address": "fa:16:3e:66:c6:13", "network": {"id": "9e975971-d987-48a6-a68b-4ccab1f23e79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-964247792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e56bb9030efe414aa52c4aa97febfd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534db674-6c", "ovs_interfaceid": "534db674-6cbc-4e0b-b7fe-25c317603b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG os_vif [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap534db674-6c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e8dfee4-02e8-4511-8910-edfabc56a52b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:08 user nova-compute[75279]: INFO os_vif [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c6:13,bridge_name='br-int',has_traffic_filtering=True,id=534db674-6cbc-4e0b-b7fe-25c317603b29,network=Network(9e975971-d987-48a6-a68b-4ccab1f23e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534db674-6c')
Nov 11 00:21:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Deleting instance files /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf_del
Nov 11 00:21:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Deletion of /opt/stack/data/nova/instances/9e720d48-0c0f-4fe6-b778-e5568e97eabf_del complete
Nov 11 00:21:09 user nova-compute[75279]: INFO nova.compute.manager [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 11 00:21:09 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:09 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Took 0.61 seconds to deallocate network for instance.
Nov 11 00:21:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-b94e53c6-f5d4-4c12-9f4e-aefe6a1659a5 req-3fcd4ec6-4d47-448e-b364-02909cc82c22 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-deleted-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:10 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Deleted allocations for instance 9e720d48-0c0f-4fe6-b778-e5568e97eabf
Nov 11 00:21:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-76240f55-ecee-4d50-b9d7-cefa918b8ec6 tempest-ServerActionsTestOtherA-191498200 tempest-ServerActionsTestOtherA-191498200-project-member] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] Acquiring lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] Lock "9e720d48-0c0f-4fe6-b778-e5568e97eabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] No waiting events found dispatching network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:10 user nova-compute[75279]: WARNING nova.compute.manager [req-29f0db5c-032e-431c-bed4-baa783cfb88c req-d97c2d7d-718d-423e-b2cf-86899925ac11 service nova] [instance: 9e720d48-0c0f-4fe6-b778-e5568e97eabf] Received unexpected event network-vif-plugged-534db674-6cbc-4e0b-b7fe-25c317603b29 for instance with vm_state deleted and task_state None.
Nov 11 00:21:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:21:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:21:11 user nova-compute[75279]: INFO nova.compute.claims [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Claim successful on node user
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:21:12 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.policy [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aef74e99ceba4defaecccad87c1bb56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf03d05069cd4066b9aa46cbc7eddc9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:21:12 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Creating image(s)
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "/opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "/opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "/opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk 1073741824" returned: 0 in 0.050s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Successfully created port: a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Cannot resize image /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Ensure instance console log exists: /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:13 user nova-compute[75279]: INFO nova.compute.manager [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Terminating instance
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-unplugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] No waiting events found dispatching network-vif-unplugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-acef2d32-f757-418d-8248-676fae14c78f req-7f28bc70-c188-4f6c-aaaa-a88e40fee9ef service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-unplugged-dff2e0bd-586f-4e19-8632-44f73cd18558 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:21:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Successfully updated port: a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquired lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-changed-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Refreshing instance network info cache due to event network-changed-a9c9f9fa-f883-47c7-bae7-0ce6006bed94. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] Acquiring lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Updating instance_info_cache with network_info: [{"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Releasing lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Instance network_info: |[{"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] Acquired lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Refreshing network info cache for port a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Start _get_guest_xml network_info=[{"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:21:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Instance destroyed successfully.
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lazy-loading 'resources' on Instance uuid a32bd458-ae96-447d-8b49-fdbee548ef3f {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-530711539',display_name='tempest-AttachVolumeNegativeTest-server-530711539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-530711539',id=31,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb0WA+zjeQm9hYhEm/2Jk9l4Ed21/du9GXpAluAYq8Kh2aJhdeiFuQY3Op/UlXzrJydRNe2/ktKBzhIZFStEZEid8GvUEukZaIVoe/rZ8nAMCev9VlbNoEkTwy8wA/QTQ==',key_name='tempest-keypair-391954778',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='683d6ebfe4794b67b6ec49ce83a46745',ramdisk_id='',reservation_id='r-ux7izbxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1189596006',owner_user_name='tempest-AttachVolumeNegativeTest-1189596006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1203d275ebd34ce1a5840ca4b34f2754',uuid=a32bd458-ae96-447d-8b49-fdbee548ef3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converting VIF {"id": "dff2e0bd-586f-4e19-8632-44f73cd18558", "address": "fa:16:3e:ae:22:7b", "network": {"id": "78ee0582-3c4c-409f-8d9d-e3085e4fc343", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-855576029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "683d6ebfe4794b67b6ec49ce83a46745", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff2e0bd-58", "ovs_interfaceid": "dff2e0bd-586f-4e19-8632-44f73cd18558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG os_vif [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:21:14 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:21:14 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff2e0bd-58, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a9faafe-9d5d-4c5d-8429-8d79b90e7219) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-738912177',display_name='tempest-ServersNegativeTestJSON-server-738912177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-738912177',id=36,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-kej1coti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:21:13Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=35564f47-7ec2-4caf-932b-53d9de80fdda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lazy-loading 'pci_devices' on Instance uuid 35564f47-7ec2-4caf-932b-53d9de80fdda {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:14 user nova-compute[75279]: INFO os_vif [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:22:7b,bridge_name='br-int',has_traffic_filtering=True,id=dff2e0bd-586f-4e19-8632-44f73cd18558,network=Network(78ee0582-3c4c-409f-8d9d-e3085e4fc343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff2e0bd-58')
Nov 11 00:21:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Deleting instance files /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f_del
Nov 11 00:21:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Deletion of /opt/stack/data/nova/instances/a32bd458-ae96-447d-8b49-fdbee548ef3f_del complete
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:21:14 user nova-compute[75279]:   <uuid>35564f47-7ec2-4caf-932b-53d9de80fdda</uuid>
Nov 11 00:21:14 user nova-compute[75279]:   <name>instance-00000024</name>
Nov 11 00:21:14 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:21:14 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:21:14 user nova-compute[75279]:   <metadata>
Nov 11 00:21:14 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:21:14 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:name>tempest-ServersNegativeTestJSON-server-738912177</nova:name>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:21:14</nova:creationTime>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:21:14 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:21:14 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:owner>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:user uuid="aef74e99ceba4defaecccad87c1bb56c">tempest-ServersNegativeTestJSON-1846058883-project-member</nova:user>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:project uuid="cf03d05069cd4066b9aa46cbc7eddc9b">tempest-ServersNegativeTestJSON-1846058883</nova:project>
Nov 11 00:21:14 user nova-compute[75279]:       </nova:owner>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:21:14 user nova-compute[75279]:       <nova:ports>
Nov 11 00:21:14 user nova-compute[75279]:         <nova:port uuid="a9c9f9fa-f883-47c7-bae7-0ce6006bed94">
Nov 11 00:21:14 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:21:14 user nova-compute[75279]:         </nova:port>
Nov 11 00:21:14 user nova-compute[75279]:       </nova:ports>
Nov 11 00:21:14 user nova-compute[75279]:     </nova:instance>
Nov 11 00:21:14 user nova-compute[75279]:   </metadata>
Nov 11 00:21:14 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:21:14 user nova-compute[75279]:     <system>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="serial">35564f47-7ec2-4caf-932b-53d9de80fdda</entry>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="uuid">35564f47-7ec2-4caf-932b-53d9de80fdda</entry>
Nov 11 00:21:14 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:21:14 user nova-compute[75279]:     </system>
Nov 11 00:21:14 user nova-compute[75279]:   </sysinfo>
Nov 11 00:21:14 user nova-compute[75279]:   <os>
Nov 11 00:21:14 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:21:14 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:21:14 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:21:14 user nova-compute[75279]:   </os>
Nov 11 00:21:14 user nova-compute[75279]:   <features>
Nov 11 00:21:14 user nova-compute[75279]:     <acpi/>
Nov 11 00:21:14 user nova-compute[75279]:     <apic/>
Nov 11 00:21:14 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:21:14 user nova-compute[75279]:   </features>
Nov 11 00:21:14 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:21:14 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:21:14 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:21:14 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:21:14 user nova-compute[75279]:   </clock>
Nov 11 00:21:14 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:21:14 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:21:14 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:21:14 user nova-compute[75279]:   </cpu>
Nov 11 00:21:14 user nova-compute[75279]:   <devices>
Nov 11 00:21:14 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:21:14 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:21:14 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk"/>
Nov 11 00:21:14 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:21:14 user nova-compute[75279]:     </disk>
Nov 11 00:21:14 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:21:14 user nova-compute[75279]:       <mac address="fa:16:3e:5f:fc:73"/>
Nov 11 00:21:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:21:14 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:21:14 user nova-compute[75279]:       <target dev="tapa9c9f9fa-f8"/>
Nov 11 00:21:14 user nova-compute[75279]:     </interface>
Nov 11 00:21:14 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:21:14 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/console.log" append="off"/>
Nov 11 00:21:14 user nova-compute[75279]:     </serial>
Nov 11 00:21:14 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:21:14 user nova-compute[75279]:     <video>
Nov 11 00:21:14 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:21:14 user nova-compute[75279]:     </video>
Nov 11 00:21:14 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:21:14 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:21:14 user nova-compute[75279]:     </rng>
Nov 11 00:21:14 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:21:14 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:21:14 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:21:14 user nova-compute[75279]:     </memballoon>
Nov 11 00:21:14 user nova-compute[75279]:   </devices>
Nov 11 00:21:14 user nova-compute[75279]: </domain>
Nov 11 00:21:14 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-738912177',display_name='tempest-ServersNegativeTestJSON-server-738912177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-738912177',id=36,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-kej1coti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:21:13Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=35564f47-7ec2-4caf-932b-53d9de80fdda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG os_vif [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '614fd2e3-6ad9-5768-9255-a76650f2935c', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9c9f9fa-f8, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9c9f9fa-f8, col_values=(('qos', UUID('9f1589d2-f8d5-47b7-8109-53eec610a297')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9c9f9fa-f8, col_values=(('external_ids', {'iface-id': 'a9c9f9fa-f883-47c7-bae7-0ce6006bed94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:fc:73', 'vm-uuid': '35564f47-7ec2-4caf-932b-53d9de80fdda'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:14 user nova-compute[75279]: INFO os_vif [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8')
Nov 11 00:21:14 user nova-compute[75279]: INFO nova.compute.manager [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] No VIF found with MAC fa:16:3e:5f:fc:73, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Updated VIF entry in instance network info cache for port a9c9f9fa-f883-47c7-bae7-0ce6006bed94. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Updating instance_info_cache with network_info: [{"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9879115c-c7e9-4e74-9006-784f2ee97ac0 req-c15a3f75-43f2-4d4f-be1d-3f2bbe79400c service nova] Releasing lock "refresh_cache-35564f47-7ec2-4caf-932b-53d9de80fdda" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:21:15 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:15 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Took 1.19 seconds to deallocate network for instance.
Nov 11 00:21:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] Acquiring lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] No waiting events found dispatching network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:16 user nova-compute[75279]: WARNING nova.compute.manager [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received unexpected event network-vif-plugged-dff2e0bd-586f-4e19-8632-44f73cd18558 for instance with vm_state deleted and task_state None.
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f014d78c-2d82-4ca6-b555-7ba938f2fb1f req-9437d8b8-79e5-4271-8f6b-fec2ae5976f2 service nova] [instance: a32bd458-ae96-447d-8b49-fdbee548ef3f] Received event network-vif-deleted-dff2e0bd-586f-4e19-8632-44f73cd18558 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:16 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Deleted allocations for instance a32bd458-ae96-447d-8b49-fdbee548ef3f
Nov 11 00:21:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] No waiting events found dispatching network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:16 user nova-compute[75279]: WARNING nova.compute.manager [req-65f139b5-a813-4372-8c64-0443f1bee4ba req-473e1d15-9b5c-4b39-8e15-fb6521dbc129 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received unexpected event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 for instance with vm_state building and task_state spawning.
Nov 11 00:21:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-28348166-4f5c-4c0d-95b4-49ff63844fb7 tempest-AttachVolumeNegativeTest-1189596006 tempest-AttachVolumeNegativeTest-1189596006-project-member] Lock "a32bd458-ae96-447d-8b49-fdbee548ef3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.objects.instance [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:18 user nova-compute[75279]: INFO nova.compute.manager [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attaching volume c26216b8-ea25-466f-9541-4e11538ba024 to /dev/vdb
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:21:18 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Instance spawned successfully.
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.utils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffb530-113b-4341-adbe-ab18cf4c7f89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ce613-f478-4901-b07c-96302ea5cec4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a7b7ec-d4b9-4633-91ee-6e9ef926f698]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef57e64-5709-4d4e-a28b-f6c6eec1552d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:18 user nova-compute[75279]: INFO nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:18 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ba4a2-0dc6-4cd7-ad4b-846183dd1cac]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG os_brick.utils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating existing volume attachment record: c04a441c-d6ca-4fed-a710-99049ae61c34 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:21:18 user nova-compute[75279]: INFO nova.compute.manager [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Took 6.73 seconds to build instance.
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-19acc678-3e03-4494-84d0-c7debc19cfc4 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.843s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] No waiting events found dispatching network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:21:18 user nova-compute[75279]: WARNING nova.compute.manager [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received unexpected event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 for instance with vm_state active and task_state None.
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-changed-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Refreshing instance network info cache due to event network-changed-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Acquiring lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Acquired lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:21:18 user nova-compute[75279]: DEBUG nova.network.neutron [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Refreshing network info cache for port ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:21:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Updated VIF entry in instance network info cache for port ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:21:19 user nova-compute[75279]: DEBUG nova.network.neutron [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating instance_info_cache with network_info: [{"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a870453-63ba-4925-b764-9a3748aabd28 req-4f75e965-096d-49a7-a5a5-d869480d9fbd service nova] Releasing lock "refresh_cache-b0de1887-6095-4062-a882-6240e5231313" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:21:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:25 user nova-compute[75279]: INFO nova.compute.manager [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attaching volume 5c009258-f198-4271-9ea4-493e6e0ccd30 to /dev/vdb
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814efec-324c-4bc6-b9d7-44c290b917bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c683dcf-3dab-46ac-853c-c54a9ea58351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91237890-62b9-45dc-9e06-05b8512d21a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0699500-d9d9-4234-84f2-cee49a293085]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:25 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:21:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace36ca-e096-442e-bf81-677f0ac7c0ff]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:21:25 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating existing volume attachment record: 972ff3f5-36a4-48d7-9a2a-267088659f72 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:21:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:35 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:21:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:21:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGkBfqZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:21:46 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:21:46 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:21:46 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ebbdb0-72c2-4d37-a0c6-72fc4e6b8415]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:21:46 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a662e2-f2da-436f-a6cb-78fe6545cd6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024] added
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c1136-6d10-4240-8b4e-2d105d6bb62d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307ff5a-4160-4799-94cb-1f4eeffeb8f7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGkBfqZJ {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGkBfqZJ" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dce014-8b95-4c6d-ad8b-5e2adcd0ce59]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dGkBfqZJ'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f1e799-079e-4633-9375-49be87d6ec35]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe13285-aeb7-428c-9fc7-442bfbe572e4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bfed71-baad-4e2a-80da-f3820a42c261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260]
Nov 11 00:21:46 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260] successful.
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2386f8c0-41bd-425e-a090-edff2e660007]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794de38-5d08-4e45-96e1-80cd5214aa09]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:46 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.798s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:46 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:21:46 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:21:46 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=24.850345611572266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681a12d-6627-42b5-bbf1-e2632e2b5cad]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:21:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGkBfqZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b0de1887-6095-4062-a882-6240e5231313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 35564f47-7ec2-4caf-932b-53d9de80fdda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.834s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== connect_volume: return (1837ms) {'type': 'block', 'scsi_wwn': '26630653636646136', 'path': '/dev/sde'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630653636646136', 'path': '/dev/sde'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.objects.instance [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:21:47 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:21:47 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:21:47 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:21:47 user nova-compute[75279]:   <serial>c26216b8-ea25-466f-9541-4e11538ba024</serial>
Nov 11 00:21:47 user nova-compute[75279]: </disk>
Nov 11 00:21:47 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No VIF found with MAC fa:16:3e:08:b9:eb, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-60b16119-017a-4539-96cd-dd9640dec322 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.099s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:21:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [{"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:52 user nova-compute[75279]: INFO nova.compute.manager [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attaching volume c9d8286d-e556-4e30-87c3-5d772ad4f772 to /dev/vdc
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.utils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9066caa6-7c93-45bc-9c7f-8f969e29d260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499d132-93d8-4fab-ab93-1bd9777681a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e6d06-ac44-413e-bbf0-375431df1768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63144ff-0c18-4c7c-ae67-2256d2e5a2da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:21:52 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0753c42d-bb51-4443-b1b7-e4cb48fa178b]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.utils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating existing volume attachment record: 10017a3e-21a8-4aee-9cb6-0996d830a23d {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtbYmnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:21:52 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:21:52 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:21:52 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2e48f-fb94-4022-b52b-c6a7e96753e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:21:52 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ddc57-5a26-4e75-83b3-56bf2ded0335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30] added
Nov 11 00:21:52 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b194d0d-cf41-4d30-8e1f-307398096f4d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b812fec-85f7-4c23-882f-5539d9ace721]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtbYmnql {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtbYmnql" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bad8a-4c09-423a-8c04-6b1c77429101]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtbYmnql'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8078af59-91ed-406c-9f53-fccb60d917e6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8b281-95b8-49bf-b330-75cd4aec517a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f666cfb-72d4-4c13-a254-9da4f9313ff1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260]
Nov 11 00:21:53 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260] successful.
Nov 11 00:21:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[504fa77c-c16c-4dd8-9fb0-08dce360930d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57b5c4-0567-4f3a-90e1-34aa34ba72ba]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)
Nov 11 00:21:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b248a5-75f1-4f27-a876-8f3740b6d98f]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:21:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtbYmnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23861663564353437', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861663564353437', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:21:54 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:21:54 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:21:54 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:21:54 user nova-compute[75279]:   <serial>5c009258-f198-4271-9ea4-493e6e0ccd30</serial>
Nov 11 00:21:54 user nova-compute[75279]: </disk>
Nov 11 00:21:54 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No VIF found with MAC fa:16:3e:18:d9:aa, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ed9a8026-e286-49bd-a8c9-fc72c437e294 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.221s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:21:57 user nova-compute[75279]: INFO nova.compute.manager [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Detaching volume 5c009258-f198-4271-9ea4-493e6e0ccd30
Nov 11 00:21:57 user nova-compute[75279]: INFO nova.virt.block_device [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attempting to driver detach volume 5c009258-f198-4271-9ea4-493e6e0ccd30 from mountpoint /dev/vdb
Nov 11 00:21:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Attempting to detach device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:21:57 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:21:57 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:21:57 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:21:57 user nova-compute[75279]:   <serial>5c009258-f198-4271-9ea4-493e6e0ccd30</serial>
Nov 11 00:21:57 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:21:57 user nova-compute[75279]: </disk>
Nov 11 00:21:57 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:21:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config.
Nov 11 00:21:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:21:57 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:21:57 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:21:57 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:21:57 user nova-compute[75279]:   <serial>5c009258-f198-4271-9ea4-493e6e0ccd30</serial>
Nov 11 00:21:57 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:21:57 user nova-compute[75279]: </disk>
Nov 11 00:21:57 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:21:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:21:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:03 user nova-compute[75279]: INFO nova.compute.manager [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Detaching volume 49c3f383-dd82-4319-bbed-bcfc5df7725d
Nov 11 00:22:03 user nova-compute[75279]: INFO nova.virt.block_device [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Attempting to driver detach volume 49c3f383-dd82-4319-bbed-bcfc5df7725d from mountpoint /dev/vdc
Nov 11 00:22:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Attempting to detach device vdc from instance c2c05958-0016-4d89-9d1a-0c593b761ab1 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:22:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:22:03 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:22:03 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:22:03 user nova-compute[75279]:   <target dev="vdc" bus="virtio"/>
Nov 11 00:22:03 user nova-compute[75279]:   <serial>49c3f383-dd82-4319-bbed-bcfc5df7725d</serial>
Nov 11 00:22:03 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:22:03 user nova-compute[75279]: </disk>
Nov 11 00:22:03 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:22:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully detached device vdc from instance c2c05958-0016-4d89-9d1a-0c593b761ab1 from the persistent domain config.
Nov 11 00:22:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c2c05958-0016-4d89-9d1a-0c593b761ab1 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:22:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:22:03 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:22:03 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:22:03 user nova-compute[75279]:   <target dev="vdc" bus="virtio"/>
Nov 11 00:22:03 user nova-compute[75279]:   <serial>49c3f383-dd82-4319-bbed-bcfc5df7725d</serial>
Nov 11 00:22:03 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:22:03 user nova-compute[75279]: </disk>
Nov 11 00:22:03 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:22:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:22:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:13 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:22:13 user nova-compute[75279]: INFO nova.compute.claims [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Claim successful on node user
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:22:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.policy [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45b9a76c019d4cc4a63342f70b6209ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd67c528cc14ba9ad1a6143a942841e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:22:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Creating image(s)
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.214s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk 1073741824" returned: 0 in 0.051s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Successfully created port: 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.211s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Cannot resize image /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Ensure instance console log exists: /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Successfully updated port: 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:22:15 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-changed-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Refreshing instance network info cache due to event network-changed-1433f4d2-b02a-474d-9d0e-3e73bb3c2273. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance network_info: |[{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Refreshing network info cache for port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start _get_guest_xml network_info=[{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:22:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:22:16 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'pci_devices' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:22:16 user nova-compute[75279]:   <uuid>67fe80fb-70cc-4242-8e85-0c7adc7052fe</uuid>
Nov 11 00:22:16 user nova-compute[75279]:   <name>instance-00000025</name>
Nov 11 00:22:16 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:22:16 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:22:16 user nova-compute[75279]:   <metadata>
Nov 11 00:22:16 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:22:16 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherB-server-1101090786</nova:name>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:22:16</nova:creationTime>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:22:16 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:22:16 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:owner>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:user uuid="45b9a76c019d4cc4a63342f70b6209ca">tempest-ServerActionsTestOtherB-720451106-project-member</nova:user>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:project uuid="dfd67c528cc14ba9ad1a6143a942841e">tempest-ServerActionsTestOtherB-720451106</nova:project>
Nov 11 00:22:16 user nova-compute[75279]:       </nova:owner>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:22:16 user nova-compute[75279]:       <nova:ports>
Nov 11 00:22:16 user nova-compute[75279]:         <nova:port uuid="1433f4d2-b02a-474d-9d0e-3e73bb3c2273">
Nov 11 00:22:16 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 00:22:16 user nova-compute[75279]:         </nova:port>
Nov 11 00:22:16 user nova-compute[75279]:       </nova:ports>
Nov 11 00:22:16 user nova-compute[75279]:     </nova:instance>
Nov 11 00:22:16 user nova-compute[75279]:   </metadata>
Nov 11 00:22:16 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:22:16 user nova-compute[75279]:     <system>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="serial">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="uuid">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:22:16 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:22:16 user nova-compute[75279]:     </system>
Nov 11 00:22:16 user nova-compute[75279]:   </sysinfo>
Nov 11 00:22:16 user nova-compute[75279]:   <os>
Nov 11 00:22:16 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:22:16 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:22:16 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:22:16 user nova-compute[75279]:   </os>
Nov 11 00:22:16 user nova-compute[75279]:   <features>
Nov 11 00:22:16 user nova-compute[75279]:     <acpi/>
Nov 11 00:22:16 user nova-compute[75279]:     <apic/>
Nov 11 00:22:16 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:22:16 user nova-compute[75279]:   </features>
Nov 11 00:22:16 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:22:16 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:22:16 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:22:16 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:22:16 user nova-compute[75279]:   </clock>
Nov 11 00:22:16 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:22:16 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:22:16 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:22:16 user nova-compute[75279]:   </cpu>
Nov 11 00:22:16 user nova-compute[75279]:   <devices>
Nov 11 00:22:16 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:22:16 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:22:16 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk"/>
Nov 11 00:22:16 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:22:16 user nova-compute[75279]:     </disk>
Nov 11 00:22:16 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:22:16 user nova-compute[75279]:       <mac address="fa:16:3e:70:c6:29"/>
Nov 11 00:22:16 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:22:16 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:22:16 user nova-compute[75279]:       <target dev="tap1433f4d2-b0"/>
Nov 11 00:22:16 user nova-compute[75279]:     </interface>
Nov 11 00:22:16 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:22:16 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/console.log" append="off"/>
Nov 11 00:22:16 user nova-compute[75279]:     </serial>
Nov 11 00:22:16 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:22:16 user nova-compute[75279]:     <video>
Nov 11 00:22:16 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:22:16 user nova-compute[75279]:     </video>
Nov 11 00:22:16 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:22:16 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:22:16 user nova-compute[75279]:     </rng>
Nov 11 00:22:16 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:22:16 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:22:16 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:22:16 user nova-compute[75279]:     </memballoon>
Nov 11 00:22:16 user nova-compute[75279]:   </devices>
Nov 11 00:22:16 user nova-compute[75279]: </domain>
Nov 11 00:22:16 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG os_vif [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b4cd6c-863c-5557-abea-65f885c17433', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1433f4d2-b0, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1433f4d2-b0, col_values=(('qos', UUID('06a226ce-9afd-4241-8a6c-c9ad9852b17e')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1433f4d2-b0, col_values=(('external_ids', {'iface-id': '1433f4d2-b02a-474d-9d0e-3e73bb3c2273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c6:29', 'vm-uuid': '67fe80fb-70cc-4242-8e85-0c7adc7052fe'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:16 user nova-compute[75279]: INFO os_vif [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No VIF found with MAC fa:16:3e:70:c6:29, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updated VIF entry in instance network info cache for port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:22:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6c296f41-36d6-401f-9ad2-c2a0dc9491db req-72ce460b-8b38-4dde-9f16-c8a10ad93fb6 service nova] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:17 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b is timed out.
Nov 11 00:22:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config.
Nov 11 00:22:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtbYmnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:22:17 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[06adf1da-f246-4969-a7c7-215e168c6b2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:22:17 user nova-compute[75279]: No targets found.
Nov 11 00:22:17 user nova-compute[75279]: iSNS:
Nov 11 00:22:17 user nova-compute[75279]: No targets found.
Nov 11 00:22:17 user nova-compute[75279]: STATIC:
Nov 11 00:22:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d
Nov 11 00:22:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:22:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:22:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30
Nov 11 00:22:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:17 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024
Nov 11 00:22:17 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:17 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:17 user nova-compute[75279]: FIRMWARE:
Nov 11 00:22:17 user nova-compute[75279]: No targets found.
Nov 11 00:22:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:22:17 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:22:17 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[049baf1a-3b93-444d-8584-54ffd5251a83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0437c44e-a74b-463c-b06a-7ee85266d3f2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 (non-flash)
Nov 11 00:22:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0727640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cb281-1d14-4c88-baf1-7ffc5b8c07ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473fabd-da4d-4961-98ad-c56212023188]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabdc175-e474-41b3-aca8-385dc0535356]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ef528-b462-4a2e-a18a-6d686598d52b]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:22:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e731b991-1c9f-48cf-8151-cec0c3af3579]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG nova.compute.manager [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:18 user nova-compute[75279]: WARNING nova.compute.manager [req-becffc6b-6fb3-4396-8c72-9f58881831b3 req-1bed0137-1c51-4241-8117-38bd8c434f46 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state building and task_state spawning.
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7109fec-5e4b-43aa-844d-de06faaade77]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260]
Nov 11 00:22:18 user nova-compute[75279]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30, portal: 172.16.0.220,3260] successful.
Nov 11 00:22:18 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c009258-f198-4271-9ea4-493e6e0ccd30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4e5607-91ef-49a9-ac2a-fbb13e95f540]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== disconnect_volume: return (405ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7b30f566-c55e-46e8-beca-79e2e1c42957 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.148s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:22:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance spawned successfully.
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:20 user nova-compute[75279]: WARNING nova.compute.manager [req-65c334f1-10a0-4f41-b5bc-675855b11073 req-196798b7-1837-449e-a6f3-320d54ee2b6e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state building and task_state spawning.
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:22:20 user nova-compute[75279]: INFO nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:22:20 user nova-compute[75279]: INFO nova.compute.manager [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Took 6.63 seconds to build instance.
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5fe84a88-5e11-43ce-a52c-a11018f81a25 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.769s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNiXstmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:22:20 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:22:20 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:22:20 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a6f049-fd63-48ca-9f07-ba14d1e8b2ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:22:20 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a2cac-9a8b-4778-81cd-2d0016ec60c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772] added
Nov 11 00:22:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54590d0-6313-4559-82e1-cf9dab8e2d54]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda94d8b-de30-41e5-8926-3bac90c46563]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNiXstmb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNiXstmb" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b74bf9-5284-44d1-b96e-718540064e6c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNiXstmb'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cf1cb-a1a4-49cc-bcc9-e38854cddf92]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964a367-a895-4947-adb3-a703d1cb5adf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ac397-76cb-4b39-99f4-a2143b930404]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260]
Nov 11 00:22:21 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260] successful.
Nov 11 00:22:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09f566-7d57-47d7-96b5-dfdbfee65c47]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1f64e-0496-4c0e-8f98-79d302ad057f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:21 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f61d2d-75b6-4823-86b5-d419570addc4]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNiXstmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:22:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23564336662373536', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564336662373536', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:22:22 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:22:22 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:22:22 user nova-compute[75279]:   <target dev="vdc" bus="virtio"/>
Nov 11 00:22:22 user nova-compute[75279]:   <serial>c9d8286d-e556-4e30-87c3-5d772ad4f772</serial>
Nov 11 00:22:22 user nova-compute[75279]: </disk>
Nov 11 00:22:22 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] No VIF found with MAC fa:16:3e:08:b9:eb, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:22:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1c6f26e2-ccda-4c71-9f77-4f347885035d tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.521s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:23 user nova-compute[75279]: INFO nova.compute.manager [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Detaching volume c9d8286d-e556-4e30-87c3-5d772ad4f772
Nov 11 00:22:23 user nova-compute[75279]: INFO nova.virt.block_device [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attempting to driver detach volume c9d8286d-e556-4e30-87c3-5d772ad4f772 from mountpoint /dev/vdc
Nov 11 00:22:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Attempting to detach device vdc from instance b0de1887-6095-4062-a882-6240e5231313 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:22:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:22:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:22:23 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:22:23 user nova-compute[75279]:   <target dev="vdc" bus="virtio"/>
Nov 11 00:22:23 user nova-compute[75279]:   <serial>c9d8286d-e556-4e30-87c3-5d772ad4f772</serial>
Nov 11 00:22:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 00:22:23 user nova-compute[75279]: </disk>
Nov 11 00:22:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:22:23 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully detached device vdc from instance b0de1887-6095-4062-a882-6240e5231313 from the persistent domain config.
Nov 11 00:22:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b0de1887-6095-4062-a882-6240e5231313 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:22:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:22:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:22:23 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:22:23 user nova-compute[75279]:   <target dev="vdc" bus="virtio"/>
Nov 11 00:22:23 user nova-compute[75279]:   <serial>c9d8286d-e556-4e30-87c3-5d772ad4f772</serial>
Nov 11 00:22:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 11 00:22:23 user nova-compute[75279]: </disk>
Nov 11 00:22:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:22:24 user nova-compute[75279]: INFO nova.compute.manager [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Unrescuing
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquired lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:22:24 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c2c05958-0016-4d89-9d1a-0c593b761ab1 is timed out.
Nov 11 00:22:24 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully detached device vdc from instance c2c05958-0016-4d89-9d1a-0c593b761ab1 from the live domain config.
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOANTklD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:22:24 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc12af-acfa-4c6e-af55-1f3ac3c5a5c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:22:24 user nova-compute[75279]: No targets found.
Nov 11 00:22:24 user nova-compute[75279]: iSNS:
Nov 11 00:22:24 user nova-compute[75279]: No targets found.
Nov 11 00:22:24 user nova-compute[75279]: STATIC:
Nov 11 00:22:24 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d
Nov 11 00:22:24 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:24 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:24 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:22:24 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:24 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:24 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772
Nov 11 00:22:24 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:24 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:24 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:22:24 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:24 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:24 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024
Nov 11 00:22:24 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:24 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:24 user nova-compute[75279]: FIRMWARE:
Nov 11 00:22:24 user nova-compute[75279]: No targets found.
Nov 11 00:22:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:22:24 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:22:24 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5822dd-f5d7-4733-8296-79525d6c864f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d292ac97-a320-4703-8d70-f6e41f0a7b8c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e07253f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090b36f-d05c-4d5a-bdd1-64bcefa4e205]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d70a63-14ca-44dc-9c57-c5b04910d223]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6c0bd-9126-4dd4-b14a-30689265c4d8]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[555345a7-f4d2-49ac-9c6d-05d64e55a89f]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e7ea4-9aa9-4c2c-bbb5-b2da0c9401e0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [{"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0bf3c-189a-4697-bdad-fdfec53b1a20]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260]
Nov 11 00:22:24 user nova-compute[75279]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d, portal: 172.16.0.220,3260] successful.
Nov 11 00:22:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Releasing lock "refresh_cache-8f4c4be6-988e-4769-84f6-cead8adf4d07" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'flavor' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c3f383-dd82-4319-bbed-bcfc5df7725d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13947e-ea6a-4422-bc4c-6c8d0d79545a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] <== disconnect_volume: return (365ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:25 user nova-compute[75279]: WARNING nova.compute.manager [req-48b5f918-e793-48fa-8d08-03906c562852 req-0fd93cc7-77e1-4c4a-8d36-995ed060dc5b service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:22:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:25 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance destroyed successfully.
Nov 11 00:22:25 user nova-compute[75279]: DEBUG nova.objects.instance [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'flavor' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fb2b6d16-494c-497f-a71b-4a881a675b18 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.028s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:27 user nova-compute[75279]: WARNING nova.compute.manager [req-35421fb9-824c-454c-95db-2dd72927eab6 req-53ff3d85-fe73-446d-b441-7da89e9d2a4c service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:29 user nova-compute[75279]: WARNING nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:22:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:29 user nova-compute[75279]: WARNING nova.compute.manager [req-2edb9e13-55ef-4500-8275-58cf92e2dafe req-5228183f-4aca-46de-b6cc-b0a67fb43d4e service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state rescued and task_state unrescuing.
Nov 11 00:22:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3cb71020-3975-422c-87cd-5f8b017b9b6c tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:22:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:39 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:22:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:44 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b0de1887-6095-4062-a882-6240e5231313 is timed out.
Nov 11 00:22:44 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully detached device vdc from instance b0de1887-6095-4062-a882-6240e5231313 from the live domain config.
Nov 11 00:22:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNiXstmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:22:44 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd9fb90-2a8b-451b-acff-ff77d6eb53d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:22:44 user nova-compute[75279]: No targets found.
Nov 11 00:22:44 user nova-compute[75279]: iSNS:
Nov 11 00:22:44 user nova-compute[75279]: No targets found.
Nov 11 00:22:44 user nova-compute[75279]: STATIC:
Nov 11 00:22:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:22:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772
Nov 11 00:22:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:22:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:44 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024
Nov 11 00:22:44 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:22:44 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:22:44 user nova-compute[75279]: FIRMWARE:
Nov 11 00:22:44 user nova-compute[75279]: No targets found.
Nov 11 00:22:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:22:44 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:22:44 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a0328-541d-4622-a723-2ac20757c50b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee960e7-d4d5-4f3f-abf7-1dd7043a7e1c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 (non-flash)
Nov 11 00:22:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f834e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a736aca-5764-4138-8faa-56f945259742]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1b51f-8e56-418f-a7aa-0d597cd8b2ad]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1d6c1-8143-495a-9ef9-03f75cdfce88]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b0c1c-ffa3-4acd-9e59-0f53f2160286]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d391f318-5932-43ee-8c6d-5a32b6563ff3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836a0df-9c5c-4668-bf77-7c44bfeb608c]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260]
Nov 11 00:22:44 user nova-compute[75279]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772, portal: 172.16.0.220,3260] successful.
Nov 11 00:22:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9d8286d-e556-4e30-87c3-5d772ad4f772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced6481-ba1e-48ce-8cf8-4b4086ced290]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== disconnect_volume: return (366ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5651d7e6-53cf-4dec-8921-d2e0b41e11bc tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.024s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:22:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:22:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:22:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=24.80893325805664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance c2c05958-0016-4d89-9d1a-0c593b761ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b0de1887-6095-4062-a882-6240e5231313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 35564f47-7ec2-4caf-932b-53d9de80fdda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:22:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:22:49 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:22:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:22:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:22:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:22:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:22:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [{"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:22:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-1e8d0ac5-6125-425f-808c-f540f57ebc5d" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:22:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:22:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:22:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:54 user nova-compute[75279]: INFO nova.compute.manager [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Terminating instance
Nov 11 00:22:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-695d0bd1-ac28-4ce3-9e42-e66a0bda4c8d req-abd4506d-6291-4483-9c89-69a02acb47c5 service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:54 user nova-compute[75279]: INFO nova.compute.manager [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attaching volume 33cfd57e-99d9-485d-ae10-4acd5dd3db27 to /dev/vdb
Nov 11 00:22:54 user nova-compute[75279]: DEBUG os_brick.utils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c3c7e8-e5da-420e-8948-4d59389ea11e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec662c10-1052-4554-b688-4f4b2dc94127]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad3fdb-041d-47ea-90c0-015af78ced0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97908e4-201f-4b60-bd68-76de4cd9c26e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:22:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Instance destroyed successfully.
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'resources' on Instance uuid c2c05958-0016-4d89-9d1a-0c593b761ab1 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:22:55 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcca2b-8fef-4288-8357-e69305ea0248]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_brick.utils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating existing volume attachment record: 186d665f-70ac-4cc4-b2ad-6b91fcfed3f6 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2127045035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2127045035',id=28,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJya/fopfTx2ZNMXgYZa1Aku8JCVN6HDwl1pMUB72CTdXAc/d983LmliDjZTafT4ZK9lrI+RLAaIA6PbRgZhJGQ+ndYx1WdF/Ey7SMLBvxoLXwXYmP0q24+Bsl5MiRPCqw==',key_name='tempest-keypair-58678597',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-0iud8xzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=c2c05958-0016-4d89-9d1a-0c593b761ab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "address": "fa:16:3e:99:66:2a", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9abbe9-24", "ovs_interfaceid": "1a9abbe9-245a-4d04-8126-92f12a5b6125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG os_vif [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9abbe9-24, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44dae2d2-81b4-4cfb-be6b-c37a150c0129) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: INFO os_vif [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:66:2a,bridge_name='br-int',has_traffic_filtering=True,id=1a9abbe9-245a-4d04-8126-92f12a5b6125,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9abbe9-24')
Nov 11 00:22:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Deleting instance files /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1_del
Nov 11 00:22:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Deletion of /opt/stack/data/nova/instances/c2c05958-0016-4d89-9d1a-0c593b761ab1_del complete
Nov 11 00:22:55 user nova-compute[75279]: INFO nova.compute.manager [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 11 00:22:55 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:56 user nova-compute[75279]: WARNING nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state active and task_state deleting.
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:56 user nova-compute[75279]: WARNING nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state active and task_state deleting.
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:56 user nova-compute[75279]: WARNING nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state active and task_state deleting.
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-76dc02ba-a45b-462e-b43e-63c3445859d6 req-a39bf101-eb08-4134-b314-973e1fb180fc service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-unplugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:22:57 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Took 2.10 seconds to deallocate network for instance.
Nov 11 00:22:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:22:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:57 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Deleted allocations for instance c2c05958-0016-4d89-9d1a-0c593b761ab1
Nov 11 00:22:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bd0dc33e-8bea-4dba-8a64-5ae61aeb1f3f tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.837s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:22:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] Acquiring lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:22:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:22:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] Lock "c2c05958-0016-4d89-9d1a-0c593b761ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:22:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] No waiting events found dispatching network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:22:58 user nova-compute[75279]: WARNING nova.compute.manager [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received unexpected event network-vif-plugged-1a9abbe9-245a-4d04-8126-92f12a5b6125 for instance with vm_state deleted and task_state None.
Nov 11 00:22:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-2cb5b954-2759-456a-b7b6-5ff13838836f req-22428c37-2883-444a-8ad4-896e5737312e service nova] [instance: c2c05958-0016-4d89-9d1a-0c593b761ab1] Received event network-vif-deleted-1a9abbe9-245a-4d04-8126-92f12a5b6125 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:01 user nova-compute[75279]: INFO nova.compute.manager [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Terminating instance
Nov 11 00:23:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-unplugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] No waiting events found dispatching network-vif-unplugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-211fc5f3-bed3-4118-845a-067a2972f52c req-5a0941db-bfde-4063-8211-9f62fae86b5a service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-unplugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Instance destroyed successfully.
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lazy-loading 'resources' on Instance uuid 35564f47-7ec2-4caf-932b-53d9de80fdda {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-738912177',display_name='tempest-ServersNegativeTestJSON-server-738912177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-738912177',id=36,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:21:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-kej1coti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:21:19Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=35564f47-7ec2-4caf-932b-53d9de80fdda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "address": "fa:16:3e:5f:fc:73", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c9f9fa-f8", "ovs_interfaceid": "a9c9f9fa-f883-47c7-bae7-0ce6006bed94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG os_vif [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9c9f9fa-f8, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f1589d2-f8d5-47b7-8109-53eec610a297) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:02 user nova-compute[75279]: INFO os_vif [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c9f9fa-f8')
Nov 11 00:23:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Deleting instance files /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda_del
Nov 11 00:23:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Deletion of /opt/stack/data/nova/instances/35564f47-7ec2-4caf-932b-53d9de80fdda_del complete
Nov 11 00:23:02 user nova-compute[75279]: INFO nova.compute.manager [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 11 00:23:02 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:23:02 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:03 user nova-compute[75279]: INFO nova.compute.manager [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Attaching volume 27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 to /dev/vdb
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.utils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b845d8-d5db-46f9-a101-8e94b481b913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb770f0-b6c5-4c91-800c-39360c38974f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a2005-566c-4336-8cb9-a4e6720fc212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fa38c-e292-4c03-9996-6e61d9408ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:23:03 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda6aeba-4978-4987-815c-1862a53dd85e]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG os_brick.utils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating existing volume attachment record: d52105c0-7d47-4ead-82f2-3e8864262b98 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-7c6215c5-d0ec-4e31-9f71-4bb09851ee94 req-35901424-194f-43ed-9e9f-0ccca554ab52 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-deleted-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:03 user nova-compute[75279]: INFO nova.compute.manager [req-7c6215c5-d0ec-4e31-9f71-4bb09851ee94 req-35901424-194f-43ed-9e9f-0ccca554ab52 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Neutron deleted interface a9c9f9fa-f883-47c7-bae7-0ce6006bed94; detaching it from the instance and deleting it from the info cache
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.network.neutron [req-7c6215c5-d0ec-4e31-9f71-4bb09851ee94 req-35901424-194f-43ed-9e9f-0ccca554ab52 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:03 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Took 1.02 seconds to deallocate network for instance.
Nov 11 00:23:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-7c6215c5-d0ec-4e31-9f71-4bb09851ee94 req-35901424-194f-43ed-9e9f-0ccca554ab52 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Detach interface failed, port_id=a9c9f9fa-f883-47c7-bae7-0ce6006bed94, reason: Instance 35564f47-7ec2-4caf-932b-53d9de80fdda could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] Acquiring lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] No waiting events found dispatching network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:04 user nova-compute[75279]: WARNING nova.compute.manager [req-49a67202-2c3a-4323-9b28-134ca3164050 req-0c6f7333-c554-4065-9c21-41ce440ac281 service nova] [instance: 35564f47-7ec2-4caf-932b-53d9de80fdda] Received unexpected event network-vif-plugged-a9c9f9fa-f883-47c7-bae7-0ce6006bed94 for instance with vm_state deleted and task_state None.
Nov 11 00:23:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:23:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:04 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Deleted allocations for instance 35564f47-7ec2-4caf-932b-53d9de80fdda
Nov 11 00:23:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e8c559e5-6b9a-4fd8-bf78-e8181fc149a7 tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "35564f47-7ec2-4caf-932b-53d9de80fdda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:23:09 user nova-compute[75279]: INFO nova.compute.claims [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Claim successful on node user
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:23:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:23:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.policy [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '477d43e1de924dd09065683f80b48d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8aed8e68304fe3b04b5afdd55b6bc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:23:10 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Creating image(s)
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "/opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "/opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "/opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk 1073741824" returned: 0 in 0.052s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Successfully created port: a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.217s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:23:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Cannot resize image /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Ensure instance console log exists: /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Successfully updated port: a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquired lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-changed-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Refreshing instance network info cache due to event network-changed-a53d3b6f-accb-4888-9f12-30f123458dc7. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] Acquiring lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Updating instance_info_cache with network_info: [{"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Releasing lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Instance network_info: |[{"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] Acquired lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Refreshing network info cache for port a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Start _get_guest_xml network_info=[{"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:23:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-737813022',display_name='tempest-VolumesActionsTest-instance-737813022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-737813022',id=38,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-p3ix6h4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:23:10Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=31bf325b-35c8-4b83-bbf8-4aafd0958573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lazy-loading 'pci_devices' on Instance uuid 31bf325b-35c8-4b83-bbf8-4aafd0958573 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:23:11 user nova-compute[75279]:   <uuid>31bf325b-35c8-4b83-bbf8-4aafd0958573</uuid>
Nov 11 00:23:11 user nova-compute[75279]:   <name>instance-00000026</name>
Nov 11 00:23:11 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:23:11 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:23:11 user nova-compute[75279]:   <metadata>
Nov 11 00:23:11 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:23:11 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:name>tempest-VolumesActionsTest-instance-737813022</nova:name>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:23:11</nova:creationTime>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:23:11 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:23:11 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:owner>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:user uuid="477d43e1de924dd09065683f80b48d8b">tempest-VolumesActionsTest-1825466312-project-member</nova:user>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:project uuid="3d8aed8e68304fe3b04b5afdd55b6bc1">tempest-VolumesActionsTest-1825466312</nova:project>
Nov 11 00:23:11 user nova-compute[75279]:       </nova:owner>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:23:11 user nova-compute[75279]:       <nova:ports>
Nov 11 00:23:11 user nova-compute[75279]:         <nova:port uuid="a53d3b6f-accb-4888-9f12-30f123458dc7">
Nov 11 00:23:11 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 11 00:23:11 user nova-compute[75279]:         </nova:port>
Nov 11 00:23:11 user nova-compute[75279]:       </nova:ports>
Nov 11 00:23:11 user nova-compute[75279]:     </nova:instance>
Nov 11 00:23:11 user nova-compute[75279]:   </metadata>
Nov 11 00:23:11 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:23:11 user nova-compute[75279]:     <system>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="serial">31bf325b-35c8-4b83-bbf8-4aafd0958573</entry>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="uuid">31bf325b-35c8-4b83-bbf8-4aafd0958573</entry>
Nov 11 00:23:11 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:23:11 user nova-compute[75279]:     </system>
Nov 11 00:23:11 user nova-compute[75279]:   </sysinfo>
Nov 11 00:23:11 user nova-compute[75279]:   <os>
Nov 11 00:23:11 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:23:11 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:23:11 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:23:11 user nova-compute[75279]:   </os>
Nov 11 00:23:11 user nova-compute[75279]:   <features>
Nov 11 00:23:11 user nova-compute[75279]:     <acpi/>
Nov 11 00:23:11 user nova-compute[75279]:     <apic/>
Nov 11 00:23:11 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:23:11 user nova-compute[75279]:   </features>
Nov 11 00:23:11 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:23:11 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:23:11 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:23:11 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:23:11 user nova-compute[75279]:   </clock>
Nov 11 00:23:11 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:23:11 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:23:11 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:23:11 user nova-compute[75279]:   </cpu>
Nov 11 00:23:11 user nova-compute[75279]:   <devices>
Nov 11 00:23:11 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:23:11 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:23:11 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk"/>
Nov 11 00:23:11 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:23:11 user nova-compute[75279]:     </disk>
Nov 11 00:23:11 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:23:11 user nova-compute[75279]:       <mac address="fa:16:3e:34:17:42"/>
Nov 11 00:23:11 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:23:11 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:23:11 user nova-compute[75279]:       <target dev="tapa53d3b6f-ac"/>
Nov 11 00:23:11 user nova-compute[75279]:     </interface>
Nov 11 00:23:11 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:23:11 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/console.log" append="off"/>
Nov 11 00:23:11 user nova-compute[75279]:     </serial>
Nov 11 00:23:11 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:23:11 user nova-compute[75279]:     <video>
Nov 11 00:23:11 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:23:11 user nova-compute[75279]:     </video>
Nov 11 00:23:11 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:23:11 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:23:11 user nova-compute[75279]:     </rng>
Nov 11 00:23:11 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:23:11 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:23:11 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:23:11 user nova-compute[75279]:     </memballoon>
Nov 11 00:23:11 user nova-compute[75279]:   </devices>
Nov 11 00:23:11 user nova-compute[75279]: </domain>
Nov 11 00:23:11 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-737813022',display_name='tempest-VolumesActionsTest-instance-737813022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-737813022',id=38,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-p3ix6h4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:23:10Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=31bf325b-35c8-4b83-bbf8-4aafd0958573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG os_vif [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6def63f-1239-5051-82e0-155ce1b6b53e', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53d3b6f-ac, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53d3b6f-ac, col_values=(('qos', UUID('63c033da-c949-44ed-a804-cedaa76cc6c1')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53d3b6f-ac, col_values=(('external_ids', {'iface-id': 'a53d3b6f-accb-4888-9f12-30f123458dc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:17:42', 'vm-uuid': '31bf325b-35c8-4b83-bbf8-4aafd0958573'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:11 user nova-compute[75279]: INFO os_vif [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac')
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] No VIF found with MAC fa:16:3e:34:17:42, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:23:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Updated VIF entry in instance network info cache for port a53d3b6f-accb-4888-9f12-30f123458dc7. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:23:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Updating instance_info_cache with network_info: [{"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eab8388b-8605-4a68-a996-701b51ea4923 req-8dd6873b-6039-40e3-81b7-4a2f6ffd5633 service nova] Releasing lock "refresh_cache-31bf325b-35c8-4b83-bbf8-4aafd0958573" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] No waiting events found dispatching network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:13 user nova-compute[75279]: WARNING nova.compute.manager [req-7dd741b5-bf11-46c5-afd2-388284a7d548 req-23133e93-3b65-4a74-b3c7-07dc2610cc02 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received unexpected event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 for instance with vm_state building and task_state spawning.
Nov 11 00:23:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:14 user nova-compute[75279]: INFO nova.compute.manager [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Detaching volume c26216b8-ea25-466f-9541-4e11538ba024
Nov 11 00:23:14 user nova-compute[75279]: INFO nova.virt.block_device [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Attempting to driver detach volume c26216b8-ea25-466f-9541-4e11538ba024 from mountpoint /dev/vdb
Nov 11 00:23:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Attempting to detach device vdb from instance b0de1887-6095-4062-a882-6240e5231313 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:23:14 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:14 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:23:14 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:14 user nova-compute[75279]:   <serial>c26216b8-ea25-466f-9541-4e11538ba024</serial>
Nov 11 00:23:14 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:23:14 user nova-compute[75279]: </disk>
Nov 11 00:23:14 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:23:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully detached device vdb from instance b0de1887-6095-4062-a882-6240e5231313 from the persistent domain config.
Nov 11 00:23:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0de1887-6095-4062-a882-6240e5231313 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:23:14 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:14 user nova-compute[75279]:   <source dev="/dev/sde"/>
Nov 11 00:23:14 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:14 user nova-compute[75279]:   <serial>c26216b8-ea25-466f-9541-4e11538ba024</serial>
Nov 11 00:23:14 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:23:14 user nova-compute[75279]: </disk>
Nov 11 00:23:14 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:23:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:23:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Instance spawned successfully.
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] No waiting events found dispatching network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:15 user nova-compute[75279]: WARNING nova.compute.manager [req-7e997bbf-025f-477b-b2f3-4ae7f59886b0 req-5b809d8f-1e1b-4658-8377-350f832fdb1e service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received unexpected event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 for instance with vm_state building and task_state spawning.
Nov 11 00:23:15 user nova-compute[75279]: INFO nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 11 00:23:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:23:15 user nova-compute[75279]: INFO nova.compute.manager [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Took 6.36 seconds to build instance.
Nov 11 00:23:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1a0bd96c-bf16-4f3c-ae21-320f1b42b54f tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.478s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZQArsgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:23:23 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:23 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:23 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e64c4-2b70-4f2a-98d0-8e2ca63f42f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:23:23 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8bfd61-da0d-40e6-bc45-bb0b07698be9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27] added
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c4c122-7de4-43d1-8dee-dbd3674e5332]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a7552-d60a-4afc-9399-081ddebf16bb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZQArsgO {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZQArsgO" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b878cff5-2ecb-4123-a3f6-afe4efe23092]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZQArsgO'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc1691c-0e80-4ae6-a36c-0abd0ef392d2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4737f-f397-4e78-80eb-225459097b82]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b906a2-f92c-46f4-a3c7-026b78108a66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260]
Nov 11 00:23:23 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260] successful.
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab1783-6480-4832-b097-0a1966c65b4b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f345611-b4f0-4a8e-855d-f2bd1fcfefd8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[530081f6-f2c6-4bc8-995f-f6d67176733b]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZQArsgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23239356266373964', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239356266373964', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:23:24 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:24 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:23:24 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:24 user nova-compute[75279]:   <serial>33cfd57e-99d9-485d-ae10-4acd5dd3db27</serial>
Nov 11 00:23:24 user nova-compute[75279]: </disk>
Nov 11 00:23:24 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No VIF found with MAC fa:16:3e:18:d9:aa, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:23:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f35eb6d1-9891-42ba-9a33-583a5f4c0b68 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.241s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:27 user nova-compute[75279]: INFO nova.compute.manager [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Detaching volume 33cfd57e-99d9-485d-ae10-4acd5dd3db27
Nov 11 00:23:27 user nova-compute[75279]: INFO nova.virt.block_device [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attempting to driver detach volume 33cfd57e-99d9-485d-ae10-4acd5dd3db27 from mountpoint /dev/vdb
Nov 11 00:23:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Attempting to detach device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:23:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:23:27 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:27 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:23:27 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:27 user nova-compute[75279]:   <serial>33cfd57e-99d9-485d-ae10-4acd5dd3db27</serial>
Nov 11 00:23:27 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:23:27 user nova-compute[75279]: </disk>
Nov 11 00:23:27 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:23:27 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config.
Nov 11 00:23:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:23:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:23:27 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:27 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:23:27 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:27 user nova-compute[75279]:   <serial>33cfd57e-99d9-485d-ae10-4acd5dd3db27</serial>
Nov 11 00:23:27 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:23:27 user nova-compute[75279]: </disk>
Nov 11 00:23:27 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:23:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:23:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:23:34 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:34 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:34 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[93872d85-4c45-4c3e-b122-63fd1aceb11c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:23:34 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03141a-b32d-4cb1-b9d3-a8764ec49707]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1] added
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f357ca-5f07-4efb-a598-6936c74e4a1b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e04b7e-85e9-44d3-a9da-79ce31addfde]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDikPFjc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDikPFjc" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e322676-7ae1-4614-ac09-98008965f2c1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDikPFjc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fedd8-c9b0-46ed-b4d0-398df6e93960]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c5b544-7c61-4397-b64a-197aceb3eecf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dcd99e-704e-4f82-a636-78c97200c4ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]
Nov 11 00:23:34 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ef613-5a9c-4f8f-b5af-697a77b5ae98]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff22f44-08ed-465d-bd75-fd5dc55dd2dd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:34 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[35083902-64cc-4f31-aba4-416cbfd8e953]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:23:34 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0de1887-6095-4062-a882-6240e5231313 is timed out.
Nov 11 00:23:34 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully detached device vdb from instance b0de1887-6095-4062-a882-6240e5231313 from the live domain config.
Nov 11 00:23:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGkBfqZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:23:34 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:34 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23738323132303832', 'path': '/dev/sdf'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738323132303832', 'path': '/dev/sdf'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.903s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12156e2-bafb-45f6-a45e-f0eac6a37009]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:23:35 user nova-compute[75279]: No targets found.
Nov 11 00:23:35 user nova-compute[75279]: iSNS:
Nov 11 00:23:35 user nova-compute[75279]: No targets found.
Nov 11 00:23:35 user nova-compute[75279]: STATIC:
Nov 11 00:23:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27
Nov 11 00:23:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:23:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:23:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:23:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024
Nov 11 00:23:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:35 user nova-compute[75279]: FIRMWARE:
Nov 11 00:23:35 user nova-compute[75279]: No targets found.
Nov 11 00:23:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:23:35 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:23:35 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:23:35 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:23:35 user nova-compute[75279]:   <source dev="/dev/sdf"/>
Nov 11 00:23:35 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:23:35 user nova-compute[75279]:   <serial>27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1</serial>
Nov 11 00:23:35 user nova-compute[75279]: </disk>
Nov 11 00:23:35 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da78a95-5b75-44f3-a55d-0a4b39e5c911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf7d5f-620b-479f-8f4e-276816f81935]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e07269e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024'): ({'sde'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Removing single pathed devices sde {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed6100-59bb-479d-bab7-a1122c6ab10a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cffedf-b3b6-441c-8c51-70229ee53584]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Flushing IO for device /dev/sde {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c109b4-0925-44f4-aba2-3d770d0d4886]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640c598-63db-4383-a99c-063e0857c944]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] SCSI volumes sde have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[17385706-ac15-47dd-8de5-96cebf61ed28]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1059c4-e396-4556-b2e9-04eccb05fc02]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260]
Nov 11 00:23:36 user nova-compute[75279]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024, portal: 172.16.0.220,3260] successful.
Nov 11 00:23:36 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26216b8-ea25-466f-9541-4e11538ba024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b951b3-a351-43e1-8b74-5366e52cf804]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] <== disconnect_volume: return (1217ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No VIF found with MAC fa:16:3e:77:61:02, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a8a87456-00bc-44f4-ba0f-1f64658bd60f tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.920s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:37 user nova-compute[75279]: DEBUG nova.objects.instance [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'flavor' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-93838371-0e5d-4f52-8296-695b35b7ad25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.884s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:37 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:23:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:23:47 user nova-compute[75279]: INFO nova.compute.claims [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Claim successful on node user
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b is timed out.
Nov 11 00:23:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config.
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZQArsgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:23:48 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc821d-d1db-42f6-a368-8ab5fcc0a009]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:23:48 user nova-compute[75279]: No targets found.
Nov 11 00:23:48 user nova-compute[75279]: iSNS:
Nov 11 00:23:48 user nova-compute[75279]: No targets found.
Nov 11 00:23:48 user nova-compute[75279]: STATIC:
Nov 11 00:23:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27
Nov 11 00:23:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:23:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:23:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:48 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:23:48 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:23:48 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:23:48 user nova-compute[75279]: FIRMWARE:
Nov 11 00:23:48 user nova-compute[75279]: No targets found.
Nov 11 00:23:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:23:48 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:23:48 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ab9d1-8bfa-4daf-b06f-970cfa4f46c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b9d7f7-ed90-48ac-a779-2e76dbdb63e4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:23:48 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0449cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f360fce-1276-42ef-98c0-007fc9c60307]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e823c-f34a-4ae3-a1ac-5d1185ae2639]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:23:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b34e16-310c-4453-bae6-570fe757ce4b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[602df567-d84e-476c-9263-73a4cbd038ee]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876a727-18c4-4675-89f4-26e368ab76b3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.policy [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93f7498f8558443eab6afb03331bc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae778b46b71f4d1db8fce5694256ebb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b42b10-0a0e-44cf-a240-e570eb0f5397]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:23:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Creating image(s)
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260]
Nov 11 00:23:49 user nova-compute[75279]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27, portal: 172.16.0.220,3260] successful.
Nov 11 00:23:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cfd57e-99d9-485d-ae10-4acd5dd3db27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0bf0d-1262-421f-a63c-ca8de9027d57]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.839s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== disconnect_volume: return (844ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:23:49 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:49 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7576MB free_disk=24.823802947998047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b0de1887-6095-4062-a882-6240e5231313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 31bf325b-35c8-4b83-bbf8-4aafd0958573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.194s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk 1073741824" returned: 0 in 0.053s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Successfully created port: d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:23:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Cannot resize image /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Ensure instance console log exists: /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dcb21a71-9f3c-4936-a273-d0a604f1cb7f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.545s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Successfully updated port: d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing instance network info cache due to event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance network_info: |[{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.neutron [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start _get_guest_xml network_info=[{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:23:50 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:50 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsSb/hzawTFebWFUg3MAGqU40aFPIZS4+y4VrLfhMeNnHnSEJGUtvY5WHZBH62XeEJ/hnX8x1KBNWQpk9r5UqPOzN7exP2k8CGHtj0CyIzrGVGoWKaGuLYeAhvvsMpUqg==',key_name='tempest-keypair-1037782947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_devices' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:23:50 user nova-compute[75279]:   <uuid>7208334b-eb49-4a4c-9e18-0fe1c47ce527</uuid>
Nov 11 00:23:50 user nova-compute[75279]:   <name>instance-00000027</name>
Nov 11 00:23:50 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:23:50 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:23:50 user nova-compute[75279]:   <metadata>
Nov 11 00:23:50 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:23:50 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1416518736</nova:name>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:23:50</nova:creationTime>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:23:50 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:23:50 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:owner>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:user uuid="93f7498f8558443eab6afb03331bc6aa">tempest-AttachVolumeShelveTestJSON-174044347-project-member</nova:user>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:project uuid="ae778b46b71f4d1db8fce5694256ebb9">tempest-AttachVolumeShelveTestJSON-174044347</nova:project>
Nov 11 00:23:50 user nova-compute[75279]:       </nova:owner>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:23:50 user nova-compute[75279]:       <nova:ports>
Nov 11 00:23:50 user nova-compute[75279]:         <nova:port uuid="d2c623af-4c0d-4784-82e9-4a39fa91b705">
Nov 11 00:23:50 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:23:50 user nova-compute[75279]:         </nova:port>
Nov 11 00:23:50 user nova-compute[75279]:       </nova:ports>
Nov 11 00:23:50 user nova-compute[75279]:     </nova:instance>
Nov 11 00:23:50 user nova-compute[75279]:   </metadata>
Nov 11 00:23:50 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:23:50 user nova-compute[75279]:     <system>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="serial">7208334b-eb49-4a4c-9e18-0fe1c47ce527</entry>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="uuid">7208334b-eb49-4a4c-9e18-0fe1c47ce527</entry>
Nov 11 00:23:50 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:23:50 user nova-compute[75279]:     </system>
Nov 11 00:23:50 user nova-compute[75279]:   </sysinfo>
Nov 11 00:23:50 user nova-compute[75279]:   <os>
Nov 11 00:23:50 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:23:50 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:23:50 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:23:50 user nova-compute[75279]:   </os>
Nov 11 00:23:50 user nova-compute[75279]:   <features>
Nov 11 00:23:50 user nova-compute[75279]:     <acpi/>
Nov 11 00:23:50 user nova-compute[75279]:     <apic/>
Nov 11 00:23:50 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:23:50 user nova-compute[75279]:   </features>
Nov 11 00:23:50 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:23:50 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:23:50 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:23:50 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:23:50 user nova-compute[75279]:   </clock>
Nov 11 00:23:50 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:23:50 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:23:50 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:23:50 user nova-compute[75279]:   </cpu>
Nov 11 00:23:50 user nova-compute[75279]:   <devices>
Nov 11 00:23:50 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:23:50 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:23:50 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk"/>
Nov 11 00:23:50 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:23:50 user nova-compute[75279]:     </disk>
Nov 11 00:23:50 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:23:50 user nova-compute[75279]:       <mac address="fa:16:3e:27:0a:d5"/>
Nov 11 00:23:50 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:23:50 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:23:50 user nova-compute[75279]:       <target dev="tapd2c623af-4c"/>
Nov 11 00:23:50 user nova-compute[75279]:     </interface>
Nov 11 00:23:50 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:23:50 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/console.log" append="off"/>
Nov 11 00:23:50 user nova-compute[75279]:     </serial>
Nov 11 00:23:50 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:23:50 user nova-compute[75279]:     <video>
Nov 11 00:23:50 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:23:50 user nova-compute[75279]:     </video>
Nov 11 00:23:50 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:23:50 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:23:50 user nova-compute[75279]:     </rng>
Nov 11 00:23:50 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:23:50 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:23:50 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:23:50 user nova-compute[75279]:     </memballoon>
Nov 11 00:23:50 user nova-compute[75279]:   </devices>
Nov 11 00:23:50 user nova-compute[75279]: </domain>
Nov 11 00:23:50 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsSb/hzawTFebWFUg3MAGqU40aFPIZS4+y4VrLfhMeNnHnSEJGUtvY5WHZBH62XeEJ/hnX8x1KBNWQpk9r5UqPOzN7exP2k8CGHtj0CyIzrGVGoWKaGuLYeAhvvsMpUqg==',key_name='tempest-keypair-1037782947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG os_vif [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f0f6839-f37d-58fc-90a6-6d22fabba26d', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2c623af-4c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2c623af-4c, col_values=(('qos', UUID('3e49ad4e-07fc-419f-89bf-42b66e726732')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2c623af-4c, col_values=(('external_ids', {'iface-id': 'd2c623af-4c0d-4784-82e9-4a39fa91b705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:0a:d5', 'vm-uuid': '7208334b-eb49-4a4c-9e18-0fe1c47ce527'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:50 user nova-compute[75279]: INFO os_vif [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c')
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:23:50 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No VIF found with MAC fa:16:3e:27:0a:d5, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updated VIF entry in instance network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-40269261-4d7d-473d-adc7-5c00c50eebfa req-89a11b8f-f951-4def-bcc8-7ecf310ddb78 service nova] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing instance network info cache due to event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updated VIF entry in instance network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1b62bb40-37b1-4b92-91c5-575fb20810af req-0394e219-c594-4038-96f2-68af08bb3866 service nova] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updating instance_info_cache with network_info: [{"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a84bf4af-a07f-4509-9d66-9d5131febfc5" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:23:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:53 user nova-compute[75279]: WARNING nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state building and task_state spawning.
Nov 11 00:23:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:23:53 user nova-compute[75279]: WARNING nova.compute.manager [req-4d32bb4e-2064-40f6-a4c1-9dd2181766f1 req-5fa89201-eb3f-4818-8b77-5b92ec9360da service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state building and task_state spawning.
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:23:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance spawned successfully.
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:23:54 user nova-compute[75279]: INFO nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 11 00:23:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:23:54 user nova-compute[75279]: INFO nova.compute.manager [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Took 7.12 seconds to build instance.
Nov 11 00:23:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9bafb753-4918-4edf-b479-961bf988dc73 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.256s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing instance network info cache due to event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:23:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:23:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updated VIF entry in instance network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:23:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:23:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8305eb86-6bc5-4088-a762-3749c4f70deb req-e9bef613-08df-4de6-9b77-cd80d77f81a2 service nova] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:23:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-changed-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Refreshing instance network info cache due to event network-changed-1433f4d2-b02a-474d-9d0e-3e73bb3c2273. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG nova.network.neutron [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Refreshing network info cache for port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:04 user nova-compute[75279]: INFO nova.compute.manager [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Terminating instance
Nov 11 00:24:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b0de1887-6095-4062-a882-6240e5231313] Instance destroyed successfully.
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lazy-loading 'resources' on Instance uuid b0de1887-6095-4062-a882-6240e5231313 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1549556685',display_name='tempest-TestServerVolumeAttachmentScenario-server-1549556685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1549556685',id=34,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPfvzfeEFewBlZeLUkdDgkVwcJ8p2J2CeB9CzQ3/PqGNNDRZAl5ElQLUz4KUFZIKTXky3dEqPgkxHHHSAi+ArOHxs8VlRojZxv1X/nMopru4Ey6LCkmsrvxjUhyGB/FdA==',key_name='tempest-keypair-1001599202',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa189dfa33b24dd9b7fbaeb2bdd59e2d',ramdisk_id='',reservation_id='r-nnidpssg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1700496772',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1700496772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='457daf84e75945a1acf6662e94ee7299',uuid=b0de1887-6095-4062-a882-6240e5231313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converting VIF {"id": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "address": "fa:16:3e:08:b9:eb", "network": {"id": "749dbb6d-0be0-4357-82e8-575a6985de64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1256733615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa189dfa33b24dd9b7fbaeb2bdd59e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9b0fcd-07", "ovs_interfaceid": "ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG os_vif [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff9b0fcd-07, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afaadc5f-5c6a-4a40-a19a-bd77abde3f70) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: INFO os_vif [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b9:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970,network=Network(749dbb6d-0be0-4357-82e8-575a6985de64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9b0fcd-07')
Nov 11 00:24:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Deleting instance files /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313_del
Nov 11 00:24:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Deletion of /opt/stack/data/nova/instances/b0de1887-6095-4062-a882-6240e5231313_del complete
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.network.neutron [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updated VIF entry in instance network info cache for port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.network.neutron [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4415dcc9-953e-450b-8e95-8da658de32c8 req-70adfcd2-e84d-40c8-b045-28dc3df7cf27 service nova] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:24:05 user nova-compute[75279]: INFO nova.compute.manager [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] [instance: b0de1887-6095-4062-a882-6240e5231313] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 11 00:24:05 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: b0de1887-6095-4062-a882-6240e5231313] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:24:05 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b0de1887-6095-4062-a882-6240e5231313] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-unplugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-unplugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-unplugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:06 user nova-compute[75279]: WARNING nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state active and task_state deleting.
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:06 user nova-compute[75279]: WARNING nova.compute.manager [req-c8dc1ed8-ed45-49f8-bb5f-7f1ecc97e9d4 req-2a844ae8-24d1-44e9-a757-8a514ba4c90f service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state active and task_state deleting.
Nov 11 00:24:07 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b0de1887-6095-4062-a882-6240e5231313] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:07 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: b0de1887-6095-4062-a882-6240e5231313] Took 1.37 seconds to deallocate network for instance.
Nov 11 00:24:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:07 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:24:07 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:24:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:07 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Deleted allocations for instance b0de1887-6095-4062-a882-6240e5231313
Nov 11 00:24:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9dc17d0a-52d7-449d-b610-daa183122f25 tempest-TestServerVolumeAttachmentScenario-1700496772 tempest-TestServerVolumeAttachmentScenario-1700496772-project-member] Lock "b0de1887-6095-4062-a882-6240e5231313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.094s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:08 user nova-compute[75279]: INFO nova.compute.manager [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Rebooting instance
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:08 user nova-compute[75279]: WARNING nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state deleted and task_state None.
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Acquiring lock "b0de1887-6095-4062-a882-6240e5231313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] Lock "b0de1887-6095-4062-a882-6240e5231313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] No waiting events found dispatching network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:08 user nova-compute[75279]: WARNING nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received unexpected event network-vif-plugged-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 for instance with vm_state deleted and task_state None.
Nov 11 00:24:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-a60fac19-3e4e-4f7c-b17a-47b365f25730 req-ae665d14-dedc-4c58-8f96-abaf4faa21ae service nova] [instance: b0de1887-6095-4062-a882-6240e5231313] Received event network-vif-deleted-ff9b0fcd-071f-43e1-b4c1-0caa4ec0a970 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:09 user nova-compute[75279]: WARNING nova.compute.manager [req-e144e662-0406-4119-a90f-cb51eac26eab req-0217c190-a173-444d-a399-a585469fec18 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state active and task_state reboot_started_hard.
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:10 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance destroyed successfully.
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'resources' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:24:09Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9e5816-01, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19591901-fd80-437a-83ad-58619b5daa55) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:10 user nova-compute[75279]: INFO os_vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01')
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:24:10 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af922d9-76b0-4f73-9960-78314cb0a853]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:24:10 user nova-compute[75279]: No targets found.
Nov 11 00:24:10 user nova-compute[75279]: iSNS:
Nov 11 00:24:10 user nova-compute[75279]: No targets found.
Nov 11 00:24:10 user nova-compute[75279]: STATIC:
Nov 11 00:24:10 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:24:10 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:10 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:10 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:24:10 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:10 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:10 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:24:10 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:10 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:10 user nova-compute[75279]: FIRMWARE:
Nov 11 00:24:10 user nova-compute[75279]: No targets found.
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:24:10 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:24:10 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5790b3-3454-43a7-9bf0-f3df367bda01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbbffa-fe6e-4092-8e24-9bda595370d1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0726cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1'): ({'sdf'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Removing single pathed devices sdf {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a2b0e4-583f-4e02-aefa-cdee7c17d472]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c70ea-922c-4fe3-8bd1-463b7012c154]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flushing IO for device /dev/sdf {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f647f7-9289-4490-9881-ea52cd4e4e08]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1560159e-9c8d-4ec6-8f78-fc2eff4fc53b]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] SCSI volumes sdf have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8dd054-b25f-4d77-8bbc-82c25aab1fd1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0291d99f-cc5f-4e30-b0ca-ea5eb301da25]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]
Nov 11 00:24:10 user nova-compute[75279]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.110s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e863a-43ba-4118-8818-997c3478fbd6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== disconnect_volume: return (391ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start _get_guest_xml network_info=[{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28f8e6f0-8534-48de-9544-8b942caa05e2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '28f8e6f0-8534-48de-9544-8b942caa05e2'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0a975698-e2e3-4f69-ba9f-236659875b4e', 'attached_at': '', 'detached_at': '', 'volume_id': '27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'serial': '27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': 'd52105c0-7d47-4ead-82f2-3e8864262b98', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:24:10 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:24:10 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28f8e6f0-8534-48de-9544-8b942caa05e2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.objects.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Object Instance<0a975698-e2e3-4f69-ba9f-236659875b4e> lazy-loaded attributes: resources,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:24:10 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:24:10 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:24:10 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e9ae2-90c0-43a9-9538-48f0184921c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:24:10 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee7f1f-0aec-45a1-8e1b-6e947f1aebf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1] added
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad57ca9-8e65-4fed-881e-3a67e2f2dcc5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efb497e-4adf-4daa-aa26-2d6d6ce29057]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDikPFjc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDikPFjc" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8d0d5-0264-4e56-8326-2ce53c3741a8]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDikPFjc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef8fa6-dc17-45ff-8402-41f36b5ce925]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b483854-1c7d-4ddb-8c0d-fc8869d0d8ee]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df420c3f-e8cb-45ae-9a5d-971ae2506f78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]
Nov 11 00:24:10 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588bedc-c45b-4a24-8ffc-5d7f722a64ef]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c112c7-d86f-4693-9abf-0ec5ab5a89e7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd14955-77bd-4f18-b8f4-a71548bebc4c]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:24:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:11 user nova-compute[75279]: WARNING nova.compute.manager [req-2d1ca399-27a4-4c96-9218-29f3d2d909e3 req-54ddeb73-fe75-4ad2-81b9-ab977a04e0d1 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state active and task_state reboot_started_hard.
Nov 11 00:24:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23738323132303832', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:24:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738323132303832', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:24:09Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Object Instance<0a975698-e2e3-4f69-ba9f-236659875b4e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:24:12 user nova-compute[75279]:   <uuid>0a975698-e2e3-4f69-ba9f-236659875b4e</uuid>
Nov 11 00:24:12 user nova-compute[75279]:   <name>instance-00000023</name>
Nov 11 00:24:12 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:24:12 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:24:12 user nova-compute[75279]:   <metadata>
Nov 11 00:24:12 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:24:12 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:name>tempest-TestMinimumBasicScenario-server-2020361293</nova:name>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:24:10</nova:creationTime>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:24:12 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:24:12 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:owner>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:user uuid="d7ed7eabc3874d63bbeca2213be1c743">tempest-TestMinimumBasicScenario-978603383-project-member</nova:user>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:project uuid="24163a6c612c4b8c87a3715b8a57fc05">tempest-TestMinimumBasicScenario-978603383</nova:project>
Nov 11 00:24:12 user nova-compute[75279]:       </nova:owner>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:root type="image" uuid="28f8e6f0-8534-48de-9544-8b942caa05e2"/>
Nov 11 00:24:12 user nova-compute[75279]:       <nova:ports>
Nov 11 00:24:12 user nova-compute[75279]:         <nova:port uuid="6c9e5816-01c4-4852-b19e-36cf8238340a">
Nov 11 00:24:12 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 00:24:12 user nova-compute[75279]:         </nova:port>
Nov 11 00:24:12 user nova-compute[75279]:       </nova:ports>
Nov 11 00:24:12 user nova-compute[75279]:     </nova:instance>
Nov 11 00:24:12 user nova-compute[75279]:   </metadata>
Nov 11 00:24:12 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:24:12 user nova-compute[75279]:     <system>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="serial">0a975698-e2e3-4f69-ba9f-236659875b4e</entry>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="uuid">0a975698-e2e3-4f69-ba9f-236659875b4e</entry>
Nov 11 00:24:12 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:24:12 user nova-compute[75279]:     </system>
Nov 11 00:24:12 user nova-compute[75279]:   </sysinfo>
Nov 11 00:24:12 user nova-compute[75279]:   <os>
Nov 11 00:24:12 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:24:12 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:24:12 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:24:12 user nova-compute[75279]:   </os>
Nov 11 00:24:12 user nova-compute[75279]:   <features>
Nov 11 00:24:12 user nova-compute[75279]:     <acpi/>
Nov 11 00:24:12 user nova-compute[75279]:     <apic/>
Nov 11 00:24:12 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:24:12 user nova-compute[75279]:   </features>
Nov 11 00:24:12 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:24:12 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:24:12 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:24:12 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:24:12 user nova-compute[75279]:   </clock>
Nov 11 00:24:12 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:24:12 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:24:12 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:24:12 user nova-compute[75279]:   </cpu>
Nov 11 00:24:12 user nova-compute[75279]:   <devices>
Nov 11 00:24:12 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:24:12 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:24:12 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk"/>
Nov 11 00:24:12 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:24:12 user nova-compute[75279]:     </disk>
Nov 11 00:24:12 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:24:12 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:24:12 user nova-compute[75279]:       <source dev="/dev/sdd"/>
Nov 11 00:24:12 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:24:12 user nova-compute[75279]:       <serial>27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1</serial>
Nov 11 00:24:12 user nova-compute[75279]:     </disk>
Nov 11 00:24:12 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:24:12 user nova-compute[75279]:       <mac address="fa:16:3e:77:61:02"/>
Nov 11 00:24:12 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:24:12 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:24:12 user nova-compute[75279]:       <target dev="tap6c9e5816-01"/>
Nov 11 00:24:12 user nova-compute[75279]:     </interface>
Nov 11 00:24:12 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:24:12 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/console.log" append="off"/>
Nov 11 00:24:12 user nova-compute[75279]:     </serial>
Nov 11 00:24:12 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:24:12 user nova-compute[75279]:     <video>
Nov 11 00:24:12 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:24:12 user nova-compute[75279]:     </video>
Nov 11 00:24:12 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:24:12 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:24:12 user nova-compute[75279]:     </rng>
Nov 11 00:24:12 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:24:12 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:24:12 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:24:12 user nova-compute[75279]:     </memballoon>
Nov 11 00:24:12 user nova-compute[75279]:   </devices>
Nov 11 00:24:12 user nova-compute[75279]: </domain>
Nov 11 00:24:12 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Object Instance<0a975698-e2e3-4f69-ba9f-236659875b4e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Cannot resize image /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'migration_context' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.objects.base [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Object Instance<0a975698-e2e3-4f69-ba9f-236659875b4e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:24:09Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG os_vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca3b4c67-88e4-5bb6-97d8-b330661f272b', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9e5816-01, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9e5816-01, col_values=(('qos', UUID('20374eaa-5c06-4472-b0ac-beefda5d1e95')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9e5816-01, col_values=(('external_ids', {'iface-id': '6c9e5816-01c4-4852-b19e-36cf8238340a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:61:02', 'vm-uuid': '0a975698-e2e3-4f69-ba9f-236659875b4e'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:12 user nova-compute[75279]: INFO os_vif [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01')
Nov 11 00:24:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:14 user nova-compute[75279]: WARNING nova.compute.manager [req-bb66dbba-a272-4222-ab56-043eb4874d4f req-d28a9f5e-acbb-42e0-be6e-8756e28a5ffa service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state active and task_state reboot_started_hard.
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:15 user nova-compute[75279]: INFO nova.compute.manager [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Terminating instance
Nov 11 00:24:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Instance destroyed successfully.
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid 8f4c4be6-988e-4769-84f6-cead8adf4d07 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536087322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536087322',id=32,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-4294y3j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:22:29Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=8f4c4be6-988e-4769-84f6-cead8adf4d07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "05814dbb-1e90-40a2-87cd-647c87a46e86", "address": "fa:16:3e:ce:8b:71", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05814dbb-1e", "ovs_interfaceid": "05814dbb-1e90-40a2-87cd-647c87a46e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_vif [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05814dbb-1e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccad239b-e779-4186-82cc-33b557b4f564) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:24:16 user nova-compute[75279]: INFO os_vif [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:8b:71,bridge_name='br-int',has_traffic_filtering=True,id=05814dbb-1e90-40a2-87cd-647c87a46e86,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05814dbb-1e')
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbcqlWhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:24:16 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee291a4-2d63-4fad-b9a0-64c4b14a686e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:24:16 user nova-compute[75279]: No targets found.
Nov 11 00:24:16 user nova-compute[75279]: iSNS:
Nov 11 00:24:16 user nova-compute[75279]: No targets found.
Nov 11 00:24:16 user nova-compute[75279]: STATIC:
Nov 11 00:24:16 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:24:16 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:16 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:16 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:24:16 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:16 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:16 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6
Nov 11 00:24:16 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:24:16 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:24:16 user nova-compute[75279]: FIRMWARE:
Nov 11 00:24:16 user nova-compute[75279]: No targets found.
Nov 11 00:24:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:24:16 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:24:16 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff908f0-253c-4fa6-947d-38c9826cc8bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[999b0694-ee4f-4ce6-8420-1f814a10ab48]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:24:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0449240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb6f62-a055-4ee5-b46d-0fa649cfe080]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b0d82-263f-403a-a921-330f23fe978b]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bcb08-5066-499d-82bf-105e5c1783cf]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f2e67-ff01-48a6-a1cd-21f7dbdd89e8]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23532373139623332', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_96af4bbf', '/dev/disk/by-id/scsi-1SCST_BIO96af4bbf-52719b32990d9714') {{(pid=86651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80fced4-4f10-4f20-8068-34662e1a83a3]: (4, None) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1462351-27bb-48f0-8287-80cbae38012b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa067a4f-8059-4892-ae42-e271d7266df4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260]
Nov 11 00:24:16 user nova-compute[75279]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6, portal: 172.16.0.220,3260] successful.
Nov 11 00:24:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df5ab7e-102d-4438-8dba-f68e86bb3eb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9be489-7d0a-4be4-9959-79628d8ec5df]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== disconnect_volume: return (368ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:24:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Deleting instance files /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07_del
Nov 11 00:24:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Deletion of /opt/stack/data/nova/instances/8f4c4be6-988e-4769-84f6-cead8adf4d07_del complete
Nov 11 00:24:16 user nova-compute[75279]: INFO nova.compute.manager [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:16 user nova-compute[75279]: WARNING nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state active and task_state reboot_started_hard.
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-unplugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Acquiring lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] No waiting events found dispatching network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:24:16 user nova-compute[75279]: WARNING nova.compute.manager [req-f608a08d-43e2-477e-8a59-54662b0ecb3c req-628558d3-e6a5-40f4-b219-f9e2bef8b783 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received unexpected event network-vif-plugged-05814dbb-1e90-40a2-87cd-647c87a46e86 for instance with vm_state active and task_state deleting.
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:24:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance rebooted successfully.
Nov 11 00:24:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:24:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b66d6f29-1e7d-40fe-b040-dc377b718769 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.766s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:17 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:17 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Took 0.54 seconds to deallocate network for instance.
Nov 11 00:24:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-32e86e84-4508-445a-b86f-bd8af09366ef req-12b53c37-d602-46f8-be87-2611e17627e6 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Received event network-vif-deleted-05814dbb-1e90-40a2-87cd-647c87a46e86 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:24:17 user nova-compute[75279]: INFO nova.compute.manager [req-32e86e84-4508-445a-b86f-bd8af09366ef req-12b53c37-d602-46f8-be87-2611e17627e6 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Neutron deleted interface 05814dbb-1e90-40a2-87cd-647c87a46e86; detaching it from the instance and deleting it from the info cache
Nov 11 00:24:17 user nova-compute[75279]: DEBUG nova.network.neutron [req-32e86e84-4508-445a-b86f-bd8af09366ef req-12b53c37-d602-46f8-be87-2611e17627e6 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-32e86e84-4508-445a-b86f-bd8af09366ef req-12b53c37-d602-46f8-be87-2611e17627e6 service nova] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Detach interface failed, port_id=05814dbb-1e90-40a2-87cd-647c87a46e86, reason: Instance 8f4c4be6-988e-4769-84f6-cead8adf4d07 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:24:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:20 user nova-compute[75279]: INFO nova.compute.manager [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 8f4c4be6-988e-4769-84f6-cead8adf4d07] Took 3.22 seconds to detach 1 volumes for instance.
Nov 11 00:24:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:20 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:24:20 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:24:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:21 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Deleted allocations for instance 8f4c4be6-988e-4769-84f6-cead8adf4d07
Nov 11 00:24:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e5d05c63-49f4-4c54-a465-4c141d7f1fff tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "8f4c4be6-988e-4769-84f6-cead8adf4d07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.937s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:24 user nova-compute[75279]: INFO nova.compute.manager [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attaching volume 5aa592cf-2faa-4de7-8329-0911fa146de2 to /dev/vdb
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.utils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f57635-7087-48c7-9dc7-356aa6746a0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dddfd69-f468-4c1f-8e60-342c2c6f19a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4760fe4-b7e9-4eee-965c-bf051d297507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[409794de-198f-488b-b5a4-00ca2a7eedbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:24:24 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:24:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44c90e3-66b9-47e6-b18f-d87ae79c0b1d]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG os_brick.utils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:24:24 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating existing volume attachment record: 0a03d2a5-96de-4fde-bdc1-7d85019e7a4a {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:24:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:24:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:24:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:24:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:24:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=24.81842803955078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a84bf4af-a07f-4509-9d66-9d5131febfc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 31bf325b-35c8-4b83-bbf8-4aafd0958573 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:24:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating instance_info_cache with network_info: [{"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-0162b017-6a6d-4795-a859-e1a591c5c69b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:24:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:24:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:24:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:24:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:24:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:24:59 user nova-compute[75279]: INFO nova.compute.manager [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Terminating instance
Nov 11 00:24:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-unplugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] No waiting events found dispatching network-vif-unplugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-d060b922-5891-4c93-970c-842b61ef7411 req-78094fb1-b0a7-4ff1-b510-adb88af81004 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-unplugged-a53d3b6f-accb-4888-9f12-30f123458dc7 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:25:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Instance destroyed successfully.
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lazy-loading 'resources' on Instance uuid 31bf325b-35c8-4b83-bbf8-4aafd0958573 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-737813022',display_name='tempest-VolumesActionsTest-instance-737813022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-737813022',id=38,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-p3ix6h4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:23:16Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=31bf325b-35c8-4b83-bbf8-4aafd0958573,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "a53d3b6f-accb-4888-9f12-30f123458dc7", "address": "fa:16:3e:34:17:42", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53d3b6f-ac", "ovs_interfaceid": "a53d3b6f-accb-4888-9f12-30f123458dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG os_vif [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53d3b6f-ac, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63c033da-c949-44ed-a804-cedaa76cc6c1) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:00 user nova-compute[75279]: INFO os_vif [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:17:42,bridge_name='br-int',has_traffic_filtering=True,id=a53d3b6f-accb-4888-9f12-30f123458dc7,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53d3b6f-ac')
Nov 11 00:25:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Deleting instance files /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573_del
Nov 11 00:25:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Deletion of /opt/stack/data/nova/instances/31bf325b-35c8-4b83-bbf8-4aafd0958573_del complete
Nov 11 00:25:00 user nova-compute[75279]: INFO nova.compute.manager [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 11 00:25:00 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:25:00 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:01 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Took 0.40 seconds to deallocate network for instance.
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-504bd306-fa44-4d83-8e95-565ef73eee2b req-02f15551-f929-455c-98ea-33c410357c70 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-deleted-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:01 user nova-compute[75279]: INFO nova.compute.manager [req-504bd306-fa44-4d83-8e95-565ef73eee2b req-02f15551-f929-455c-98ea-33c410357c70 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Neutron deleted interface a53d3b6f-accb-4888-9f12-30f123458dc7; detaching it from the instance and deleting it from the info cache
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-504bd306-fa44-4d83-8e95-565ef73eee2b req-02f15551-f929-455c-98ea-33c410357c70 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-504bd306-fa44-4d83-8e95-565ef73eee2b req-02f15551-f929-455c-98ea-33c410357c70 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Detach interface failed, port_id=a53d3b6f-accb-4888-9f12-30f123458dc7, reason: Instance 31bf325b-35c8-4b83-bbf8-4aafd0958573 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:25:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:01 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Deleted allocations for instance 31bf325b-35c8-4b83-bbf8-4aafd0958573
Nov 11 00:25:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-96cb750a-4f4f-4dd5-bb5e-5eb44ddfe6e0 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.617s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] Acquiring lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] Lock "31bf325b-35c8-4b83-bbf8-4aafd0958573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] No waiting events found dispatching network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:02 user nova-compute[75279]: WARNING nova.compute.manager [req-9b8661e4-fcd2-4b7c-8af2-04d536f81a55 req-9e9afca3-422b-44fa-90c8-8b3365be7b74 service nova] [instance: 31bf325b-35c8-4b83-bbf8-4aafd0958573] Received unexpected event network-vif-plugged-a53d3b6f-accb-4888-9f12-30f123458dc7 for instance with vm_state deleted and task_state None.
Nov 11 00:25:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtaJleS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:25:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:25:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:25:04 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e8bd88-df30-48c9-b69c-2c720410a293]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:25:04 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92c5f5-e89e-4c3f-859d-59b9d683d9a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2] added
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7f609d-0715-411b-a40a-db0f97d664a9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad8721-613d-4437-a50e-ffb9cfb35b84]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFtaJleS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFtaJleS" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5690b7b-e809-4d51-930b-7821116d2f58]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFtaJleS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785d227-7cb8-4e20-82f6-1c1d7b21d0cc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f893b81-9af6-4b5f-84d5-a18f4576a306]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34940c-3812-478e-9f8d-4ea6769f8c8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260]
Nov 11 00:25:04 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260] successful.
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44cee06-c397-489e-8f75-f6042dbb4ae3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae33e185-8a9c-4425-b56b-add5902e2bd2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)
Nov 11 00:25:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ec87a-7a71-4518-b3a8-e9a3c009f01d]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtaJleS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23262393632346330', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262393632346330', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:25:05 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:25:05 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:25:05 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:25:05 user nova-compute[75279]:   <serial>5aa592cf-2faa-4de7-8329-0911fa146de2</serial>
Nov 11 00:25:05 user nova-compute[75279]: </disk>
Nov 11 00:25:05 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:25:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] No VIF found with MAC fa:16:3e:18:d9:aa, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:06 user nova-compute[75279]: INFO nova.compute.manager [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Terminating instance
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-57775a5f-2aba-45f9-aa41-c37702332b89 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.171s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-unplugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] No waiting events found dispatching network-vif-unplugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-7dad5a2f-16bb-4b4a-aaf9-1949b7e78551 req-b4396800-827c-4315-bf4e-ee8ec14ca292 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-unplugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Instance destroyed successfully.
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid a84bf4af-a07f-4509-9d66-9d5131febfc5 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274183713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274183713',id=27,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-dttuzvqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:16:50Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a84bf4af-a07f-4509-9d66-9d5131febfc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "address": "fa:16:3e:55:db:01", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa007bd-ac", "ovs_interfaceid": "eaa007bd-acf7-45e7-b9c8-b70989f8370a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG os_vif [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaa007bd-ac, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00f62739-4e93-42a6-88c7-a886ef732b96) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:07 user nova-compute[75279]: INFO os_vif [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:db:01,bridge_name='br-int',has_traffic_filtering=True,id=eaa007bd-acf7-45e7-b9c8-b70989f8370a,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa007bd-ac')
Nov 11 00:25:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Deleting instance files /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5_del
Nov 11 00:25:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Deletion of /opt/stack/data/nova/instances/a84bf4af-a07f-4509-9d66-9d5131febfc5_del complete
Nov 11 00:25:07 user nova-compute[75279]: INFO nova.compute.manager [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 11 00:25:07 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:25:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:08 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Took 0.61 seconds to deallocate network for instance.
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:08 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Deleted allocations for instance a84bf4af-a07f-4509-9d66-9d5131febfc5
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e1664a07-f7bc-47d0-8ed7-2a77c6e34508 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:08 user nova-compute[75279]: INFO nova.compute.manager [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Detaching volume 5aa592cf-2faa-4de7-8329-0911fa146de2
Nov 11 00:25:08 user nova-compute[75279]: INFO nova.virt.block_device [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Attempting to driver detach volume 5aa592cf-2faa-4de7-8329-0911fa146de2 from mountpoint /dev/vdb
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Attempting to detach device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:25:08 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:25:08 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:25:08 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:25:08 user nova-compute[75279]:   <serial>5aa592cf-2faa-4de7-8329-0911fa146de2</serial>
Nov 11 00:25:08 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:25:08 user nova-compute[75279]: </disk>
Nov 11 00:25:08 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:25:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the persistent domain config.
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:25:08 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:25:08 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:25:08 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:25:08 user nova-compute[75279]:   <serial>5aa592cf-2faa-4de7-8329-0911fa146de2</serial>
Nov 11 00:25:08 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:25:08 user nova-compute[75279]: </disk>
Nov 11 00:25:08 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] Acquiring lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] Lock "a84bf4af-a07f-4509-9d66-9d5131febfc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] No waiting events found dispatching network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:08 user nova-compute[75279]: WARNING nova.compute.manager [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received unexpected event network-vif-plugged-eaa007bd-acf7-45e7-b9c8-b70989f8370a for instance with vm_state deleted and task_state None.
Nov 11 00:25:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-dad3cb1d-f978-4a4b-8cd8-b1563544caac req-85129822-fa45-468f-bc51-eecdf71ceea0 service nova] [instance: a84bf4af-a07f-4509-9d66-9d5131febfc5] Received event network-vif-deleted-eaa007bd-acf7-45e7-b9c8-b70989f8370a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:25:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:29 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0162b017-6a6d-4795-a859-e1a591c5c69b is timed out.
Nov 11 00:25:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully detached device vdb from instance 0162b017-6a6d-4795-a859-e1a591c5c69b from the live domain config.
Nov 11 00:25:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFtaJleS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:25:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189a760-1b92-4c30-8f30-1303efa8d0ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:25:29 user nova-compute[75279]: No targets found.
Nov 11 00:25:29 user nova-compute[75279]: iSNS:
Nov 11 00:25:29 user nova-compute[75279]: No targets found.
Nov 11 00:25:29 user nova-compute[75279]: STATIC:
Nov 11 00:25:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:25:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:25:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:25:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2
Nov 11 00:25:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:25:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:25:29 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:25:29 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:25:29 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:25:29 user nova-compute[75279]: FIRMWARE:
Nov 11 00:25:29 user nova-compute[75279]: No targets found.
Nov 11 00:25:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:25:29 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:25:29 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bbe731-8751-4835-8913-e0c04747c2e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cd739-b774-4559-8e3e-416a2b238662]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 (non-flash)
Nov 11 00:25:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71c07a80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[120cd1ea-9a86-44dd-b863-8ac0d4a6f549]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d584c5b-e62d-4def-ad61-3b9eb1555d27]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a76ba-0c12-47c1-b122-cac92a7019cc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf6846-1442-46a0-bb9e-9b21ac99c0dd]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f77fb-d9d7-43f2-bb3d-85d6d5ec6411]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0da452-f44a-49d3-9457-7d1c8a0dba3c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260]
Nov 11 00:25:29 user nova-compute[75279]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2, portal: 172.16.0.220,3260] successful.
Nov 11 00:25:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa592cf-2faa-4de7-8329-0911fa146de2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d63b3f-83f6-4449-bce6-958c83e5a87a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] <== disconnect_volume: return (346ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:25:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:25:30 user nova-compute[75279]: DEBUG nova.objects.instance [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'flavor' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cdfc245d-8fc6-4047-b6a0-28b80e08921f tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:25:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:38 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:38 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing instance network info cache due to event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updated VIF entry in instance network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG nova.network.neutron [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e88cffef-3903-4793-b53f-e0b8ddd4803f req-adcb3201-bb0f-4f27-a6c1-6aeb69850836 service nova] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:40 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:25:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:45 user nova-compute[75279]: INFO nova.compute.manager [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Shelving
Nov 11 00:25:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:46 user nova-compute[75279]: WARNING nova.compute.manager [req-a08c7a87-8069-4859-b894-bed6581dc871 req-74ec6ddf-e61a-4134-aa1b-7ed9d7f94c08 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving.
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance destroyed successfully.
Nov 11 00:25:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Beginning cold snapshot process
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk /opt/stack/data/nova/instances/snapshots/tmpnks1jj1i/a1b10d762ace4ba19152c07079a3a929 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk /opt/stack/data/nova/instances/snapshots/tmpnks1jj1i/a1b10d762ace4ba19152c07079a3a929" returned: 0 in 0.409s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:47 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Snapshot extracted, beginning image upload
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.compute.manager [req-30b1c644-e715-4f43-b088-427e26e7f80f req-6d286005-8230-4712-b473-4bb4a1116466 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state shelving_image_uploading.
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:25:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8090MB free_disk=24.953018188476562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:25:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:50 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Snapshot image upload complete
Nov 11 00:25:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:25:50 user nova-compute[75279]: INFO nova.compute.manager [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Shelve offloading
Nov 11 00:25:50 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance destroyed successfully.
Nov 11 00:25:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:25:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:25:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:25:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance destroyed successfully.
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'resources' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsSb/hzawTFebWFUg3MAGqU40aFPIZS4+y4VrLfhMeNnHnSEJGUtvY5WHZBH62XeEJ/hnX8x1KBNWQpk9r5UqPOzN7exP2k8CGHtj0CyIzrGVGoWKaGuLYeAhvvsMpUqg==',key_name='tempest-keypair-1037782947',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:23:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:25:50.323586',shelved_host='user',shelved_image_id='ba51e381-e4ea-41e5-afbe-e5b1f5a88773'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG os_vif [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2c623af-4c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing instance network info cache due to event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e49ad4e-07fc-419f-89bf-42b66e726732) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:51 user nova-compute[75279]: INFO os_vif [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c')
Nov 11 00:25:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Deleting instance files /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527_del
Nov 11 00:25:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Deletion of /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527_del complete
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:51 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:25:51 user nova-compute[75279]: INFO nova.compute.claims [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Claim successful on node user
Nov 11 00:25:51 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Deleted allocations for instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527
Nov 11 00:25:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updated VIF entry in instance network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd2c623af-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.253s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'numa_topology' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-365eccc4-fd93-4760-b35e-7d72e5198a21 req-27667bb9-b858-431b-b0f8-e1918051930a service nova] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.objects.base [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<7208334b-eb49-4a4c-9e18-0fe1c47ce527> lazy-loaded attributes: resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:25:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.policy [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '477d43e1de924dd09065683f80b48d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8aed8e68304fe3b04b5afdd55b6bc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:25:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Creating image(s)
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "/opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "/opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "/opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0bc8aa1-11af-4403-92d6-a9e32b0db25d tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.815s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk 1073741824" returned: 0 in 0.052s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Successfully created port: cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Cannot resize image /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Ensure instance console log exists: /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Successfully updated port: cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquired lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.neutron [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Updating instance_info_cache with network_info: [{"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-changed-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Refreshing instance network info cache due to event network-changed-cbed320d-57e1-435d-9328-4a0bdfb5102e. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] Acquiring lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Releasing lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Instance network_info: |[{"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] Acquired lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Refreshing network info cache for port cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Start _get_guest_xml network_info=[{"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:25:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:25:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1620318965',display_name='tempest-VolumesActionsTest-instance-1620318965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1620318965',id=40,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-wq10h6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:25:52Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=36d6ecf6-8d2c-416a-b54e-37e4a4257051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:53 user nova-compute[75279]: DEBUG nova.objects.instance [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lazy-loading 'pci_devices' on Instance uuid 36d6ecf6-8d2c-416a-b54e-37e4a4257051 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:25:54 user nova-compute[75279]:   <uuid>36d6ecf6-8d2c-416a-b54e-37e4a4257051</uuid>
Nov 11 00:25:54 user nova-compute[75279]:   <name>instance-00000028</name>
Nov 11 00:25:54 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:25:54 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:25:54 user nova-compute[75279]:   <metadata>
Nov 11 00:25:54 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:25:54 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:name>tempest-VolumesActionsTest-instance-1620318965</nova:name>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:25:53</nova:creationTime>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:25:54 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:25:54 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:owner>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:user uuid="477d43e1de924dd09065683f80b48d8b">tempest-VolumesActionsTest-1825466312-project-member</nova:user>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:project uuid="3d8aed8e68304fe3b04b5afdd55b6bc1">tempest-VolumesActionsTest-1825466312</nova:project>
Nov 11 00:25:54 user nova-compute[75279]:       </nova:owner>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:25:54 user nova-compute[75279]:       <nova:ports>
Nov 11 00:25:54 user nova-compute[75279]:         <nova:port uuid="cbed320d-57e1-435d-9328-4a0bdfb5102e">
Nov 11 00:25:54 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:25:54 user nova-compute[75279]:         </nova:port>
Nov 11 00:25:54 user nova-compute[75279]:       </nova:ports>
Nov 11 00:25:54 user nova-compute[75279]:     </nova:instance>
Nov 11 00:25:54 user nova-compute[75279]:   </metadata>
Nov 11 00:25:54 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:25:54 user nova-compute[75279]:     <system>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="serial">36d6ecf6-8d2c-416a-b54e-37e4a4257051</entry>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="uuid">36d6ecf6-8d2c-416a-b54e-37e4a4257051</entry>
Nov 11 00:25:54 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:25:54 user nova-compute[75279]:     </system>
Nov 11 00:25:54 user nova-compute[75279]:   </sysinfo>
Nov 11 00:25:54 user nova-compute[75279]:   <os>
Nov 11 00:25:54 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:25:54 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:25:54 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:25:54 user nova-compute[75279]:   </os>
Nov 11 00:25:54 user nova-compute[75279]:   <features>
Nov 11 00:25:54 user nova-compute[75279]:     <acpi/>
Nov 11 00:25:54 user nova-compute[75279]:     <apic/>
Nov 11 00:25:54 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:25:54 user nova-compute[75279]:   </features>
Nov 11 00:25:54 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:25:54 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:25:54 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:25:54 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:25:54 user nova-compute[75279]:   </clock>
Nov 11 00:25:54 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:25:54 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:25:54 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:25:54 user nova-compute[75279]:   </cpu>
Nov 11 00:25:54 user nova-compute[75279]:   <devices>
Nov 11 00:25:54 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:25:54 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:25:54 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk"/>
Nov 11 00:25:54 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:25:54 user nova-compute[75279]:     </disk>
Nov 11 00:25:54 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:25:54 user nova-compute[75279]:       <mac address="fa:16:3e:4e:b0:53"/>
Nov 11 00:25:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:25:54 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:25:54 user nova-compute[75279]:       <target dev="tapcbed320d-57"/>
Nov 11 00:25:54 user nova-compute[75279]:     </interface>
Nov 11 00:25:54 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:25:54 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/console.log" append="off"/>
Nov 11 00:25:54 user nova-compute[75279]:     </serial>
Nov 11 00:25:54 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:25:54 user nova-compute[75279]:     <video>
Nov 11 00:25:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:25:54 user nova-compute[75279]:     </video>
Nov 11 00:25:54 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:25:54 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:25:54 user nova-compute[75279]:     </rng>
Nov 11 00:25:54 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:25:54 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:25:54 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:25:54 user nova-compute[75279]:     </memballoon>
Nov 11 00:25:54 user nova-compute[75279]:   </devices>
Nov 11 00:25:54 user nova-compute[75279]: </domain>
Nov 11 00:25:54 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1620318965',display_name='tempest-VolumesActionsTest-instance-1620318965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1620318965',id=40,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-wq10h6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:25:52Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=36d6ecf6-8d2c-416a-b54e-37e4a4257051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG os_vif [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d2f6cd4-008d-5c99-a0ec-55705f72d689', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbed320d-57, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbed320d-57, col_values=(('qos', UUID('320ffd9f-1a62-4df3-9392-4c6b1da28526')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbed320d-57, col_values=(('external_ids', {'iface-id': 'cbed320d-57e1-435d-9328-4a0bdfb5102e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b0:53', 'vm-uuid': '36d6ecf6-8d2c-416a-b54e-37e4a4257051'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:54 user nova-compute[75279]: INFO os_vif [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57')
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] No VIF found with MAC fa:16:3e:4e:b0:53, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Updated VIF entry in instance network info cache for port cbed320d-57e1-435d-9328-4a0bdfb5102e. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Updating instance_info_cache with network_info: [{"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6992190f-3bb2-43ba-b87e-63f71165e899 req-28e1adef-a983-499b-a1a2-82ad41aadfa4 service nova] Releasing lock "refresh_cache-36d6ecf6-8d2c-416a-b54e-37e4a4257051" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] No waiting events found dispatching network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:55 user nova-compute[75279]: WARNING nova.compute.manager [req-9d5de902-760b-4f35-a15d-3739be950a78 req-a7c5f08f-c89c-4379-8bda-ecaf7a3cb2d6 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received unexpected event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e for instance with vm_state building and task_state spawning.
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:57 user nova-compute[75279]: INFO nova.compute.manager [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Terminating instance
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:25:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Instance spawned successfully.
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] No waiting events found dispatching network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:57 user nova-compute[75279]: WARNING nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received unexpected event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e for instance with vm_state building and task_state spawning.
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-unplugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Acquiring lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] No waiting events found dispatching network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:25:57 user nova-compute[75279]: WARNING nova.compute.manager [req-efd89ff8-778b-48fc-bbe7-6fd762be3c67 req-0d7d77c2-4c54-44df-82df-d2ee7b45e113 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received unexpected event network-vif-plugged-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 for instance with vm_state active and task_state deleting.
Nov 11 00:25:57 user nova-compute[75279]: INFO nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Instance destroyed successfully.
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid 1e8d0ac5-6125-425f-808c-f540f57ebc5d {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:25:57 user nova-compute[75279]: INFO nova.compute.manager [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Took 6.08 seconds to build instance.
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-553191854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-553191854',id=20,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ggghjtx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:13:04Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=1e8d0ac5-6125-425f-808c-f540f57ebc5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "address": "fa:16:3e:1c:e0:58", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4439a833-cc", "ovs_interfaceid": "4439a833-cca8-4f9b-ad1f-f6684b2af4b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_vif [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4439a833-cc, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a599df9c-c351-41ac-8a32-4d7f018678c2) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:25:57 user nova-compute[75279]: INFO os_vif [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:e0:58,bridge_name='br-int',has_traffic_filtering=True,id=4439a833-cca8-4f9b-ad1f-f6684b2af4b9,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4439a833-cc')
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fa2522f2-5322-48ec-918e-cefb24faaa07 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.199s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sERMGNZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:25:57 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[069c9f05-7355-494a-ab59-05c31bec4a89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:25:57 user nova-compute[75279]: No targets found.
Nov 11 00:25:57 user nova-compute[75279]: iSNS:
Nov 11 00:25:57 user nova-compute[75279]: No targets found.
Nov 11 00:25:57 user nova-compute[75279]: STATIC:
Nov 11 00:25:57 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973
Nov 11 00:25:57 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:25:57 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:25:57 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:25:57 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:25:57 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:25:57 user nova-compute[75279]: FIRMWARE:
Nov 11 00:25:57 user nova-compute[75279]: No targets found.
Nov 11 00:25:57 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:25:57 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:25:57 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed282470-1107-4417-a203-e7891191ba94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d76a95-ba67-4c8e-a190-0f55f2b897a8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:58 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 (non-flash)
Nov 11 00:25:58 user nova-compute[75279]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:25:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f72000ab1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c5009-bcae-4eaa-9846-eea526417634]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7f6c9-635e-4ed5-bdeb-3550a8eb1ee7]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e220647-d38d-4df7-a35e-71fa2793e446]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a88dff-bfaa-4197-8da1-06a434a3377f]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f48aac-a2a7-4c07-8531-34713e194057]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce73c31-892c-4eae-ab81-a6eeea3a441b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260]
Nov 11 00:25:58 user nova-compute[75279]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973, portal: 172.16.0.220,3260] successful.
Nov 11 00:25:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e39473d-2111-4332-8489-2498186b2973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85c544-c785-43b3-b798-fd8766e00325]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] <== disconnect_volume: return (325ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:25:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Deleting instance files /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d_del
Nov 11 00:25:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Deletion of /opt/stack/data/nova/instances/1e8d0ac5-6125-425f-808c-f540f57ebc5d_del complete
Nov 11 00:25:58 user nova-compute[75279]: INFO nova.compute.manager [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 11 00:25:58 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:25:58 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:25:58 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Took 0.50 seconds to deallocate network for instance.
Nov 11 00:25:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e673c07-887f-4895-8ca6-72de6152e9cf req-09eb9ce8-ba39-4069-8c9d-c6859a92bab8 service nova] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Received event network-vif-deleted-4439a833-cca8-4f9b-ad1f-f6684b2af4b9 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:00 user nova-compute[75279]: INFO nova.compute.manager [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: 1e8d0ac5-6125-425f-808c-f540f57ebc5d] Took 1.19 seconds to detach 1 volumes for instance.
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:00 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Deleted allocations for instance 1e8d0ac5-6125-425f-808c-f540f57ebc5d
Nov 11 00:26:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing instance network info cache due to event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:26:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c63f1812-263c-4f11-8925-38720fc41491 tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "1e8d0ac5-6125-425f-808c-f540f57ebc5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.678s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updated VIF entry in instance network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:26:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:26:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ec2b4e44-f814-44d5-93d0-feb8861ea48b req-eb49aa63-6f52-4397-b92f-55f0e18bee5b service nova] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing instance network info cache due to event network-changed-6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] Acquiring lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] Acquired lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Refreshing network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:02 user nova-compute[75279]: INFO nova.compute.manager [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Detaching volume 27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:26:02 user nova-compute[75279]: INFO nova.virt.block_device [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Attempting to driver detach volume 27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 from mountpoint /dev/vdb
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Attempting to detach device vdb from instance 0a975698-e2e3-4f69-ba9f-236659875b4e from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:26:02 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:26:02 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:26:02 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:26:02 user nova-compute[75279]:   <serial>27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1</serial>
Nov 11 00:26:02 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:26:02 user nova-compute[75279]: </disk>
Nov 11 00:26:02 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:26:02 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully detached device vdb from instance 0a975698-e2e3-4f69-ba9f-236659875b4e from the persistent domain config.
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a975698-e2e3-4f69-ba9f-236659875b4e from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:26:02 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:26:02 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:26:02 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:26:02 user nova-compute[75279]:   <serial>27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1</serial>
Nov 11 00:26:02 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 11 00:26:02 user nova-compute[75279]: </disk>
Nov 11 00:26:02 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updated VIF entry in instance network info cache for port 6c9e5816-01c4-4852-b19e-36cf8238340a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [{"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-289b04e7-e02c-438c-aba7-be771e6efd1f req-6ed01233-09bc-4f6c-9d49-7f80801afec6 service nova] Releasing lock "refresh_cache-0a975698-e2e3-4f69-ba9f-236659875b4e" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:26:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'flavor' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:04 user nova-compute[75279]: INFO nova.compute.manager [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Attaching volume 46d95553-6760-45d7-a227-2eeb6f56b46e to /dev/vdb
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d45ad-14ea-4a97-81d8-bbbba3a6b424]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[497d2e44-cd6c-4d08-8c51-09352dad3a94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[093adf47-45b3-4194-b9d0-7d36b2084bad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5c6e7-974f-4415-b061-d96be982c166]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:26:04 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:26:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30bed5-8641-4fa3-b734-4e0e092801c6]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:26:04 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating existing volume attachment record: 6253dab1-6a31-46ce-9bfb-75d9377e4cc1 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:26:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a975698-e2e3-4f69-ba9f-236659875b4e is timed out.
Nov 11 00:26:23 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully detached device vdb from instance 0a975698-e2e3-4f69-ba9f-236659875b4e from the live domain config.
Nov 11 00:26:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDikPFjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:26:23 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb5598-a586-402d-a66c-a33bd5547333]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:26:23 user nova-compute[75279]: No targets found.
Nov 11 00:26:23 user nova-compute[75279]: iSNS:
Nov 11 00:26:23 user nova-compute[75279]: No targets found.
Nov 11 00:26:23 user nova-compute[75279]: STATIC:
Nov 11 00:26:23 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1
Nov 11 00:26:23 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:26:23 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:26:23 user nova-compute[75279]: FIRMWARE:
Nov 11 00:26:23 user nova-compute[75279]: No targets found.
Nov 11 00:26:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:26:23 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:26:23 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b38ab-97eb-439a-8382-44a0ec2bd597]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02e0d71-8657-417a-9601-0d1c2f7c2b15]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:26:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 (non-flash)
Nov 11 00:26:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f82c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7e530-c939-4818-afb8-18f69a8995a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f1c56-6652-422e-8cb8-d8faad92a8ab]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[be412e6e-d857-4372-836f-774771862990]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3f7c4-99ed-4e1a-80e0-5cc06b994b21]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea317c9f-ab41-4f8e-b124-279cd630c8e1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4f002-a863-4b5c-a6ff-cc94e9a44f2b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260]
Nov 11 00:26:23 user nova-compute[75279]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1, portal: 172.16.0.220,3260] successful.
Nov 11 00:26:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a61c6f-c5f0-4dd0-bcec-ddf199e9ccb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8750b4-671d-41e1-83e6-f8a0baa13d13]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== disconnect_volume: return (283ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:26:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:26:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:26:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-bf9afed6-a68c-4f4a-82e3-e57696e6097c tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.991s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:26:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:26:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:26:29 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ba3fd-67ef-4696-8d70-d6d7d7c9427b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:26:29 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45b11b5-aa8a-427d-a81b-9d79532f0316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added
Nov 11 00:26:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c07aeb2-5ff4-4975-8f77-f9a1a99b5f76]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d51c1c-196f-49b9-aa2b-6b5e2c0920f0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b52ecf-be16-424b-801c-b3c51d8ec2fc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NtknhSis'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ba825b-4797-49e4-b71c-dd8653d09c21]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c6c0f-df27-4c67-ad51-c85caf8c6584]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:26:29 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:26:29 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:26:29 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:26:29 user nova-compute[75279]: 
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c816e-e7be-4b4d-a4be-2e29fd8013ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:26:29 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:26:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdf5e9a-3d0c-4229-b217-581104e23792]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6825aa09-d2df-42c5-ab42-6d828104f370]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:26:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:26:29 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c6548-d48e-42ee-8ff3-23012a9bdd7a]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:29 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'flavor' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:26:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:26:30 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:26:30 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:26:30 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:26:30 user nova-compute[75279]:   <serial>46d95553-6760-45d7-a227-2eeb6f56b46e</serial>
Nov 11 00:26:30 user nova-compute[75279]: </disk>
Nov 11 00:26:30 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:26:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:26:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:26:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No VIF found with MAC fa:16:3e:70:c6:29, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:26:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f6bf8b99-590f-44cf-82b0-3f81be90d230 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.835s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Stashing vm_state: active {{(pid=75279) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 11 00:26:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:26:33 user nova-compute[75279]: INFO nova.compute.claims [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Claim successful on node user
Nov 11 00:26:34 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating resource usage from migration 95c385e8-4b04-4a20-8303-94912eac7c47
Nov 11 00:26:34 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.326s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:34 user nova-compute[75279]: INFO nova.compute.manager [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Migrating
Nov 11 00:26:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Starting migrate_disk_and_power_off {{(pid=75279) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:26:35 user nova-compute[75279]: WARNING nova.compute.manager [req-a6a71a80-a94e-47a6-8494-6c30d2554e8f req-a347f601-acd0-42b0-8944-ccf4bee15229 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state active and task_state resize_migrating.
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance destroyed successfully.
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1433f4d2-b0, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06a226ce-9afd-4241-8a6c-c9ad9852b17e) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:35 user nova-compute[75279]: INFO os_vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:26:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c34e4d-977d-4884-acfd-35ec6a5d8c12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:26:35 user nova-compute[75279]: No targets found.
Nov 11 00:26:35 user nova-compute[75279]: iSNS:
Nov 11 00:26:35 user nova-compute[75279]: No targets found.
Nov 11 00:26:35 user nova-compute[75279]: STATIC:
Nov 11 00:26:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e
Nov 11 00:26:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:26:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:26:35 user nova-compute[75279]: FIRMWARE:
Nov 11 00:26:35 user nova-compute[75279]: No targets found.
Nov 11 00:26:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:26:35 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:26:35 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ad5ae-43f5-4b21-9221-d5fed54f8b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf21b59-7529-4890-8691-f219a5a9e61b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:26:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:26:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e077f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f0af9-3d2b-49ba-9a75-e83013b02f6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a4bab7-8be4-46cb-8a8c-f758cceef5e1]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665c9c1-3be0-492f-b2c0-507ed2218ac7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[758423e5-841d-44a3-8f14-6a93bb8f2542]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0480c0-7644-47fb-ac3f-65f00b6293bf]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea029d2-171e-4f36-8773-f1a64f94537a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:26:35 user nova-compute[75279]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:26:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f535c7-2722-4fc7-87f5-58a9cd8bc01f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== disconnect_volume: return (308ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:26:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_resize/disk /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "cp -r /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_resize/disk /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk" returned: 0 in 0.294s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_resize/disk.info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk.info {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:36 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "cp -r /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_resize/disk.info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk.info" returned: 0 in 0.031s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:26:37 user nova-compute[75279]: WARNING nova.compute.manager [req-44fe12a2-2a5d-40a3-af88-cbbf286a7938 req-c95e6710-0c75-4ea2-9689-9c90158361c9 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state active and task_state resize_migrating.
Nov 11 00:26:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:41 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:26:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:47 user nova-compute[75279]: INFO nova.compute.manager [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Terminating instance
Nov 11 00:26:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-unplugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] No waiting events found dispatching network-vif-unplugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e50b687-47c7-4e9e-8e96-055d5fdff496 req-2b3148f9-54a4-40e2-9f69-c90615617c79 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-unplugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 binding to destination host user is already ACTIVE {{(pid=75279) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Instance destroyed successfully.
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.objects.instance [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lazy-loading 'resources' on Instance uuid a1af67ad-6a4c-48d7-bbe7-9223db2a5f39 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16073207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16073207',id=16,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5707b16ebb6042e08f11590de3c92bca',ramdisk_id='',reservation_id='r-ninscn6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-319780688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:08:13Z,user_data=None,user_id='223cf2dd1ecd4a12a5db181391692422',uuid=a1af67ad-6a4c-48d7-bbe7-9223db2a5f39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converting VIF {"id": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "address": "fa:16:3e:26:a0:a9", "network": {"id": "712f5d2b-23d2-4820-af3d-5d37c1cbe39c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-560867536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5707b16ebb6042e08f11590de3c92bca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa388b4c3-2b", "ovs_interfaceid": "a388b4c3-2b82-4f31-98e3-1765fd0c79e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG os_vif [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa388b4c3-2b, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c8e99fc-ff76-4963-adaf-98efabc43f6c) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:26:48 user nova-compute[75279]: INFO os_vif [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a0:a9,bridge_name='br-int',has_traffic_filtering=True,id=a388b4c3-2b82-4f31-98e3-1765fd0c79e4,network=Network(712f5d2b-23d2-4820-af3d-5d37c1cbe39c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa388b4c3-2b')
Nov 11 00:26:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Deleting instance files /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39_del
Nov 11 00:26:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Deletion of /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39_del complete
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json" returned: 1 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk --force-share --output=json' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:26:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000010, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a1af67ad-6a4c-48d7-bbe7-9223db2a5f39/disk
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:48 user nova-compute[75279]: INFO nova.compute.manager [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.utils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce955b-11e3-448d-847b-d4b35a76854c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[72185eab-2977-45a4-8fd6-33f5c6ae2195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Took 0.63 seconds to deallocate network for instance.
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-d5883ff5-f707-48e3-b9bb-4782a4b9f53f req-dd7f5beb-433a-409d-bca3-d52a48302ec7 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-deleted-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e6d13-b8eb-4932-ac77-5eb273e47759]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5dc58f-9f7b-4658-b6b9-65c02225f24a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:26:49 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060bc98-0285-4f4e-b33c-2f5a9d35590a]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG os_brick.utils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:26:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:26:50 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:26:50 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8233MB free_disk=24.864578247070312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] Acquiring lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] No waiting events found dispatching network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:26:50 user nova-compute[75279]: WARNING nova.compute.manager [req-a6c164da-49f9-4b44-9e34-42edeaa75770 req-e9d12c2c-866f-4e55-a412-dea52d81bee6 service nova] [instance: a1af67ad-6a4c-48d7-bbe7-9223db2a5f39] Received unexpected event network-vif-plugged-a388b4c3-2b82-4f31-98e3-1765fd0c79e4 for instance with vm_state deleted and task_state None.
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.972s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.142s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:50 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Deleted allocations for instance a1af67ad-6a4c-48d7-bbe7-9223db2a5f39
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe as it has an incoming, in-progress migration 95c385e8-4b04-4a20-8303-94912eac7c47. Migration status is post-migrating {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:26:50 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating resource usage from migration 95c385e8-4b04-4a20-8303-94912eac7c47
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0162b017-6a6d-4795-a859-e1a591c5c69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 0a975698-e2e3-4f69-ba9f-236659875b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 36d6ecf6-8d2c-416a-b54e-37e4a4257051 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration 95c385e8-4b04-4a20-8303-94912eac7c47 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-55adb8a8-a28a-4e0e-81c7-39088c1dc4ad tempest-ServerBootFromVolumeStableRescueTest-319780688 tempest-ServerBootFromVolumeStableRescueTest-319780688-project-member] Lock "a1af67ad-6a4c-48d7-bbe7-9223db2a5f39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:26:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 2dd490b4-6b20-4579-86c5-1e6b052389aa {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 36d6ecf6-8d2c-416a-b54e-37e4a4257051 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:52 user nova-compute[75279]: INFO nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] During sync_power_state the instance has a pending task (resize_finish). Skip.
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:26:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:26:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:04 user nova-compute[75279]: INFO nova.compute.manager [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Terminating instance
Nov 11 00:27:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-bed3b39a-1fa4-4b82-834b-5a8f3439d834 req-87b992b8-1553-4636-b6e9-3c49a9a9e5fc service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-unplugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:27:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Instance destroyed successfully.
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'resources' on Instance uuid 0a975698-e2e3-4f69-ba9f-236659875b4e {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020361293',display_name='tempest-TestMinimumBasicScenario-server-2020361293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020361293',id=35,image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnW6gBXsK63fLdzklqme3lGkne2VXC2Eq/TFWKZKrq5qbsTmrXflLT6AJ6M/njzZgc9w2DlG2KgUbC+67yk8+m/k7PIJxHy7zoV+1/qiNTg6XHTKrnEw0T7HC1R9HVag==',key_name='tempest-TestMinimumBasicScenario-1680577538',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-jnr8klli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28f8e6f0-8534-48de-9544-8b942caa05e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:24:17Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=0a975698-e2e3-4f69-ba9f-236659875b4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "6c9e5816-01c4-4852-b19e-36cf8238340a", "address": "fa:16:3e:77:61:02", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9e5816-01", "ovs_interfaceid": "6c9e5816-01c4-4852-b19e-36cf8238340a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG os_vif [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9e5816-01, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20374eaa-5c06-4472-b0ac-beefda5d1e95) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:05 user nova-compute[75279]: INFO os_vif [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:61:02,bridge_name='br-int',has_traffic_filtering=True,id=6c9e5816-01c4-4852-b19e-36cf8238340a,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9e5816-01')
Nov 11 00:27:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Deleting instance files /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e_del
Nov 11 00:27:05 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Deletion of /opt/stack/data/nova/instances/0a975698-e2e3-4f69-ba9f-236659875b4e_del complete
Nov 11 00:27:05 user nova-compute[75279]: INFO nova.compute.manager [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 11 00:27:05 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:27:05 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:06 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Took 0.67 seconds to deallocate network for instance.
Nov 11 00:27:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-73637ead-55b1-430f-85f8-8862df38c8d3 req-1dff145f-3466-4d1f-80e5-3b1ac83c9ac3 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-deleted-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:06 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Deleted allocations for instance 0a975698-e2e3-4f69-ba9f-236659875b4e
Nov 11 00:27:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-aaa1c655-4b2c-4de2-a60a-6e92954bc1a8 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] Acquiring lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] Lock "0a975698-e2e3-4f69-ba9f-236659875b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] No waiting events found dispatching network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:07 user nova-compute[75279]: WARNING nova.compute.manager [req-08d4280c-3aa1-49c2-a89b-e4f2e3c71cd7 req-18543667-1161-4405-b3f8-e9a41283af46 service nova] [instance: 0a975698-e2e3-4f69-ba9f-236659875b4e] Received unexpected event network-vif-plugged-6c9e5816-01c4-4852-b19e-36cf8238340a for instance with vm_state deleted and task_state None.
Nov 11 00:27:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:27:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:27:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:38 user nova-compute[75279]: INFO nova.compute.manager [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Unshelving
Nov 11 00:27:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_requests' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'numa_topology' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:27:38 user nova-compute[75279]: INFO nova.compute.claims [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Claim successful on node user
Nov 11 00:27:38 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:39 user nova-compute[75279]: INFO nova.network.neutron [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating port d2c623af-4c0d-4784-82e9-4a39fa91b705 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG nova.network.neutron [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG nova.compute.manager [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing instance network info cache due to event network-changed-d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:27:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] Acquiring lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG nova.network.neutron [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:27:40 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Creating image(s)
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] Acquired lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Refreshing network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG nova.objects.base [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<7208334b-eb49-4a4c-9e18-0fe1c47ce527> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG nova.virt.images [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] ba51e381-e4ea-41e5-afbe-e5b1f5a88773 was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.part /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updated VIF entry in instance network info cache for port d2c623af-4c0d-4784-82e9-4a39fa91b705. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-32db3ea8-d8ef-4a8d-ac4e-1eaac6ff50d4 req-c63089c7-fd58-4fd9-8d1d-ad96adccc520 service nova] Releasing lock "refresh_cache-7208334b-eb49-4a4c-9e18-0fe1c47ce527" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.part /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.converted" returned: 0 in 0.555s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.909s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:42 user nova-compute[75279]: INFO nova.compute.manager [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Terminating instance
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.compute.manager [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json" returned: 0 in 0.193s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039,backing_fmt=raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039,backing_fmt=raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk 1073741824" returned: 0 in 0.051s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "ea949ab008750eef9d2e2a77148ada5cba6b7039" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 --force-share --output=json" returned: 0 in 0.200s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'migration_context' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.objects.base [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<7208334b-eb49-4a4c-9e18-0fe1c47ce527> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:27:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Rebasing disk image.
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-unplugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] No waiting events found dispatching network-vif-unplugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-9398cff6-26ce-4ceb-baf4-e98732eab9a8 req-92e04ae4-5b5c-41b3-a60d-2d2b9c0c1c50 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-unplugged-cbed320d-57e1-435d-9328-4a0bdfb5102e for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.258s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a -F raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Instance destroyed successfully.
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.objects.instance [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lazy-loading 'resources' on Instance uuid 36d6ecf6-8d2c-416a-b54e-37e4a4257051 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1620318965',display_name='tempest-VolumesActionsTest-instance-1620318965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1620318965',id=40,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8aed8e68304fe3b04b5afdd55b6bc1',ramdisk_id='',reservation_id='r-wq10h6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1825466312',owner_user_name='tempest-VolumesActionsTest-1825466312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:25:58Z,user_data=None,user_id='477d43e1de924dd09065683f80b48d8b',uuid=36d6ecf6-8d2c-416a-b54e-37e4a4257051,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converting VIF {"id": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "address": "fa:16:3e:4e:b0:53", "network": {"id": "f45a7c57-f957-4384-87c9-49b997bf80ac", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180372386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8aed8e68304fe3b04b5afdd55b6bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbed320d-57", "ovs_interfaceid": "cbed320d-57e1-435d-9328-4a0bdfb5102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG os_vif [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbed320d-57, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=320ffd9f-1a62-4df3-9392-4c6b1da28526) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:43 user nova-compute[75279]: INFO os_vif [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b0:53,bridge_name='br-int',has_traffic_filtering=True,id=cbed320d-57e1-435d-9328-4a0bdfb5102e,network=Network(f45a7c57-f957-4384-87c9-49b997bf80ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbed320d-57')
Nov 11 00:27:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Deleting instance files /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051_del
Nov 11 00:27:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Deletion of /opt/stack/data/nova/instances/36d6ecf6-8d2c-416a-b54e-37e4a4257051_del complete
Nov 11 00:27:43 user nova-compute[75279]: INFO nova.compute.manager [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 11 00:27:43 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:43 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Took 0.46 seconds to deallocate network for instance.
Nov 11 00:27:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:43 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Deleted allocations for instance 36d6ecf6-8d2c-416a-b54e-37e4a4257051
Nov 11 00:27:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-297d6904-cb21-4f1c-b9f6-ca18c60d3294 tempest-VolumesActionsTest-1825466312 tempest-VolumesActionsTest-1825466312-project-member] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.662s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] Acquiring lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] Lock "36d6ecf6-8d2c-416a-b54e-37e4a4257051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] No waiting events found dispatching network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:44 user nova-compute[75279]: WARNING nova.compute.manager [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received unexpected event network-vif-plugged-cbed320d-57e1-435d-9328-4a0bdfb5102e for instance with vm_state deleted and task_state None.
Nov 11 00:27:44 user nova-compute[75279]: DEBUG nova.compute.manager [req-fc515628-1854-4a8c-9517-40519b2e637b req-6821cc8b-7d46-44ba-bc9f-da788b1a0db5 service nova] [instance: 36d6ecf6-8d2c-416a-b54e-37e4a4257051] Received event network-vif-deleted-cbed320d-57e1-435d-9328-4a0bdfb5102e {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a -F raw /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk" returned: 0 in 2.073s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Ensure instance console log exists: /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start _get_guest_xml network_info=[{"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7a1c764c8e628e41b6c0c98049b595d5',container_format='bare',created_at=2023-11-11T00:25:46Z,direct_url=<?>,disk_format='qcow2',id=ba51e381-e4ea-41e5-afbe-e5b1f5a88773,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1416518736-shelved',owner='ae778b46b71f4d1db8fce5694256ebb9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:25:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:27:45 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:45 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7a1c764c8e628e41b6c0c98049b595d5',container_format='bare',created_at=2023-11-11T00:25:46Z,direct_url=<?>,disk_format='qcow2',id=ba51e381-e4ea-41e5-afbe-e5b1f5a88773,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1416518736-shelved',owner='ae778b46b71f4d1db8fce5694256ebb9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:25:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.objects.base [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<7208334b-eb49-4a4c-9e18-0fe1c47ce527> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='ba51e381-e4ea-41e5-afbe-e5b1f5a88773',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1037782947',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:23:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:25:50.323586',shelved_host='user',shelved_image_id='ba51e381-e4ea-41e5-afbe-e5b1f5a88773'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'pci_devices' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.objects.base [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Object Instance<7208334b-eb49-4a4c-9e18-0fe1c47ce527> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:27:45 user nova-compute[75279]:   <uuid>7208334b-eb49-4a4c-9e18-0fe1c47ce527</uuid>
Nov 11 00:27:45 user nova-compute[75279]:   <name>instance-00000027</name>
Nov 11 00:27:45 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:27:45 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:27:45 user nova-compute[75279]:   <metadata>
Nov 11 00:27:45 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:27:45 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1416518736</nova:name>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:27:45</nova:creationTime>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:27:45 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:27:45 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:owner>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:user uuid="93f7498f8558443eab6afb03331bc6aa">tempest-AttachVolumeShelveTestJSON-174044347-project-member</nova:user>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:project uuid="ae778b46b71f4d1db8fce5694256ebb9">tempest-AttachVolumeShelveTestJSON-174044347</nova:project>
Nov 11 00:27:45 user nova-compute[75279]:       </nova:owner>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:root type="image" uuid="ba51e381-e4ea-41e5-afbe-e5b1f5a88773"/>
Nov 11 00:27:45 user nova-compute[75279]:       <nova:ports>
Nov 11 00:27:45 user nova-compute[75279]:         <nova:port uuid="d2c623af-4c0d-4784-82e9-4a39fa91b705">
Nov 11 00:27:45 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:27:45 user nova-compute[75279]:         </nova:port>
Nov 11 00:27:45 user nova-compute[75279]:       </nova:ports>
Nov 11 00:27:45 user nova-compute[75279]:     </nova:instance>
Nov 11 00:27:45 user nova-compute[75279]:   </metadata>
Nov 11 00:27:45 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:27:45 user nova-compute[75279]:     <system>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="serial">7208334b-eb49-4a4c-9e18-0fe1c47ce527</entry>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="uuid">7208334b-eb49-4a4c-9e18-0fe1c47ce527</entry>
Nov 11 00:27:45 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:27:45 user nova-compute[75279]:     </system>
Nov 11 00:27:45 user nova-compute[75279]:   </sysinfo>
Nov 11 00:27:45 user nova-compute[75279]:   <os>
Nov 11 00:27:45 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:27:45 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:27:45 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:27:45 user nova-compute[75279]:   </os>
Nov 11 00:27:45 user nova-compute[75279]:   <features>
Nov 11 00:27:45 user nova-compute[75279]:     <acpi/>
Nov 11 00:27:45 user nova-compute[75279]:     <apic/>
Nov 11 00:27:45 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:27:45 user nova-compute[75279]:   </features>
Nov 11 00:27:45 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:27:45 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:27:45 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:27:45 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:27:45 user nova-compute[75279]:   </clock>
Nov 11 00:27:45 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:27:45 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:27:45 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:27:45 user nova-compute[75279]:   </cpu>
Nov 11 00:27:45 user nova-compute[75279]:   <devices>
Nov 11 00:27:45 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:27:45 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:27:45 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk"/>
Nov 11 00:27:45 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:27:45 user nova-compute[75279]:     </disk>
Nov 11 00:27:45 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:27:45 user nova-compute[75279]:       <mac address="fa:16:3e:27:0a:d5"/>
Nov 11 00:27:45 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:27:45 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:27:45 user nova-compute[75279]:       <target dev="tapd2c623af-4c"/>
Nov 11 00:27:45 user nova-compute[75279]:     </interface>
Nov 11 00:27:45 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:27:45 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/console.log" append="off"/>
Nov 11 00:27:45 user nova-compute[75279]:     </serial>
Nov 11 00:27:45 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:27:45 user nova-compute[75279]:     <video>
Nov 11 00:27:45 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:27:45 user nova-compute[75279]:     </video>
Nov 11 00:27:45 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:27:45 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:27:45 user nova-compute[75279]:     </rng>
Nov 11 00:27:45 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:27:45 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:27:45 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:27:45 user nova-compute[75279]:     </memballoon>
Nov 11 00:27:45 user nova-compute[75279]:   </devices>
Nov 11 00:27:45 user nova-compute[75279]: </domain>
Nov 11 00:27:45 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='ba51e381-e4ea-41e5-afbe-e5b1f5a88773',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1037782947',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:23:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member',shelved_at='2023-11-11T00:25:50.323586',shelved_host='user',shelved_image_id='ba51e381-e4ea-41e5-afbe-e5b1f5a88773'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG os_vif [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f0f6839-f37d-58fc-90a6-6d22fabba26d', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2c623af-4c, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2c623af-4c, col_values=(('qos', UUID('e718d090-a4a3-4984-827b-f26f54bbf932')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2c623af-4c, col_values=(('external_ids', {'iface-id': 'd2c623af-4c0d-4784-82e9-4a39fa91b705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:0a:d5', 'vm-uuid': '7208334b-eb49-4a4c-9e18-0fe1c47ce527'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:45 user nova-compute[75279]: INFO os_vif [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c')
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] No VIF found with MAC fa:16:3e:27:0a:d5, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Starting finish_migration {{(pid=75279) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 11 00:27:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance directory exists: not creating {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 11 00:27:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Creating image(s)
Nov 11 00:27:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:47 user nova-compute[75279]: WARNING nova.compute.manager [req-5a562e7c-0acf-4a1b-9e1a-f8a6ae5611ce req-5c3bbd42-d98c-45f1-bd0c-248ef6d71659 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:47 user nova-compute[75279]: INFO nova.compute.manager [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Terminating instance
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.300s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk. size=21474836480 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-unplugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] No waiting events found dispatching network-vif-unplugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-abf1500c-7f98-4422-aa85-ac2925a81f93 req-bf387f90-0fd0-44a3-bee2-b4d774126cf8 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-unplugged-7e1799ab-1710-4018-9430-e0b30594c452 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk 21474836480 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk 21474836480" returned: 0 in 0.070s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Ensure instance console log exists: /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start _get_guest_xml network_info=[{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '67fe80fb-70cc-4242-8e85-0c7adc7052fe', 'attached_at': '2023-11-11T00:27:47.000000', 'detached_at': '', 'volume_id': '46d95553-6760-45d7-a227-2eeb6f56b46e', 'serial': '46d95553-6760-45d7-a227-2eeb6f56b46e'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '3ef5be3e-65d3-4b65-b943-cd7f94fa409b', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:47 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:27:47 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:27:47 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:27:47 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a33e799-bfb0-4004-8144-f5cfaeb41fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:27:47 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5f884-284b-4063-8de7-c56207c0415a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added
Nov 11 00:27:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e473c3f-6601-4920-b451-503cf08923af]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2835ba3-f552-466b-8230-3d20cdc14362]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb718e-c928-48f5-addb-8adb25e3d557]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NtknhSis'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2026cbb1-31d0-40f9-a465-e0ca6ffb0b7d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9788367e-63c6-430e-a642-65f88dff1ebd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:27:47 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:27:47 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:27:47 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:27:47 user nova-compute[75279]: 
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176d6fc-5749-457f-a486-0726ebd13b49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:27:47 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:27:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e77c1-47fa-49ff-933e-74ef0fa90c47]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b81bd-565b-408e-b855-5201bcf87c49]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:27:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:27:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e35c1-45e6-42e8-bc8c-3cce99914504]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:27:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:27:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Instance destroyed successfully.
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.objects.instance [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lazy-loading 'resources' on Instance uuid 0162b017-6a6d-4795-a859-e1a591c5c69b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance spawned successfully.
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-743921993',display_name='tempest-SnapshotDataIntegrityTests-server-743921993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-743921993',id=30,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD/VvBY5PUnq1NMR/AlQDQdf3zk+UZ23VFZuc6bkcN8xx//nKdmIg5cG4T+xlmsb9gGKH8SHmPSmuiGYYaNi3nc/M5sSYXaL+814w9g47d3/c8/+yHZ1kClQZP4TVJ+7Q==',key_name='tempest-keypair-2057103682',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:17:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='158d2b8b80664ad6b19aea5cdb6256dd',ramdisk_id='',reservation_id='r-btrgrsw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1016885518',owner_user_name='tempest-SnapshotDataIntegrityTests-1016885518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='456ee0c643b348d59145b05cbaa9fc19',uuid=0162b017-6a6d-4795-a859-e1a591c5c69b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converting VIF {"id": "7e1799ab-1710-4018-9430-e0b30594c452", "address": "fa:16:3e:18:d9:aa", "network": {"id": "13bf7c22-fd31-41b8-b42c-0766cb8eccde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1315655922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "158d2b8b80664ad6b19aea5cdb6256dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1799ab-17", "ovs_interfaceid": "7e1799ab-1710-4018-9430-e0b30594c452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG os_vif [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e1799ab-17, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2d481dd-9305-4716-9c01-d913e9beeaf4) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:48 user nova-compute[75279]: INFO os_vif [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d9:aa,bridge_name='br-int',has_traffic_filtering=True,id=7e1799ab-1710-4018-9430-e0b30594c452,network=Network(13bf7c22-fd31-41b8-b42c-0766cb8eccde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1799ab-17')
Nov 11 00:27:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Deleting instance files /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b_del
Nov 11 00:27:48 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Deletion of /opt/stack/data/nova/instances/0162b017-6a6d-4795-a859-e1a591c5c69b_del complete
Nov 11 00:27:48 user nova-compute[75279]: INFO nova.compute.manager [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Took 1.79 seconds to destroy the instance on the hypervisor.
Nov 11 00:27:48 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:27:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:49 user nova-compute[75279]: WARNING nova.compute.manager [req-7aedbf8d-2e0a-4ea2-8dde-db3cd86c4d81 req-ab9e2db8-cbdd-40d2-801b-23c9e5c88829 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:27:49 user nova-compute[75279]:   <uuid>67fe80fb-70cc-4242-8e85-0c7adc7052fe</uuid>
Nov 11 00:27:49 user nova-compute[75279]:   <name>instance-00000025</name>
Nov 11 00:27:49 user nova-compute[75279]:   <memory>2097152</memory>
Nov 11 00:27:49 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:27:49 user nova-compute[75279]:   <metadata>
Nov 11 00:27:49 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:27:49 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherB-server-1101090786</nova:name>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:27:47</nova:creationTime>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:flavor name="m1.small">
Nov 11 00:27:49 user nova-compute[75279]:         <nova:memory>2048</nova:memory>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:disk>20</nova:disk>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:27:49 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:owner>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:user uuid="45b9a76c019d4cc4a63342f70b6209ca">tempest-ServerActionsTestOtherB-720451106-project-member</nova:user>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:project uuid="dfd67c528cc14ba9ad1a6143a942841e">tempest-ServerActionsTestOtherB-720451106</nova:project>
Nov 11 00:27:49 user nova-compute[75279]:       </nova:owner>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:27:49 user nova-compute[75279]:       <nova:ports>
Nov 11 00:27:49 user nova-compute[75279]:         <nova:port uuid="1433f4d2-b02a-474d-9d0e-3e73bb3c2273">
Nov 11 00:27:49 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 00:27:49 user nova-compute[75279]:         </nova:port>
Nov 11 00:27:49 user nova-compute[75279]:       </nova:ports>
Nov 11 00:27:49 user nova-compute[75279]:     </nova:instance>
Nov 11 00:27:49 user nova-compute[75279]:   </metadata>
Nov 11 00:27:49 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:27:49 user nova-compute[75279]:     <system>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="serial">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="uuid">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:27:49 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:27:49 user nova-compute[75279]:     </system>
Nov 11 00:27:49 user nova-compute[75279]:   </sysinfo>
Nov 11 00:27:49 user nova-compute[75279]:   <os>
Nov 11 00:27:49 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:27:49 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:27:49 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:27:49 user nova-compute[75279]:   </os>
Nov 11 00:27:49 user nova-compute[75279]:   <features>
Nov 11 00:27:49 user nova-compute[75279]:     <acpi/>
Nov 11 00:27:49 user nova-compute[75279]:     <apic/>
Nov 11 00:27:49 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:27:49 user nova-compute[75279]:   </features>
Nov 11 00:27:49 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:27:49 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:27:49 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:27:49 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:27:49 user nova-compute[75279]:   </clock>
Nov 11 00:27:49 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:27:49 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:27:49 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:27:49 user nova-compute[75279]:   </cpu>
Nov 11 00:27:49 user nova-compute[75279]:   <devices>
Nov 11 00:27:49 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:27:49 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:27:49 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk"/>
Nov 11 00:27:49 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:27:49 user nova-compute[75279]:     </disk>
Nov 11 00:27:49 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:27:49 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:27:49 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:27:49 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:27:49 user nova-compute[75279]:       <serial>46d95553-6760-45d7-a227-2eeb6f56b46e</serial>
Nov 11 00:27:49 user nova-compute[75279]:     </disk>
Nov 11 00:27:49 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:27:49 user nova-compute[75279]:       <mac address="fa:16:3e:70:c6:29"/>
Nov 11 00:27:49 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:27:49 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:27:49 user nova-compute[75279]:       <target dev="tap1433f4d2-b0"/>
Nov 11 00:27:49 user nova-compute[75279]:     </interface>
Nov 11 00:27:49 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:27:49 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/console.log" append="off"/>
Nov 11 00:27:49 user nova-compute[75279]:     </serial>
Nov 11 00:27:49 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:27:49 user nova-compute[75279]:     <video>
Nov 11 00:27:49 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:27:49 user nova-compute[75279]:     </video>
Nov 11 00:27:49 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:27:49 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:27:49 user nova-compute[75279]:     </rng>
Nov 11 00:27:49 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:27:49 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:27:49 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:27:49 user nova-compute[75279]:     </memballoon>
Nov 11 00:27:49 user nova-compute[75279]:   </devices>
Nov 11 00:27:49 user nova-compute[75279]: </domain>
Nov 11 00:27:49 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007608766-network", "vif_mac": "fa:16:3e:70:c6:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG os_vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b4cd6c-863c-5557-abea-65f885c17433', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1433f4d2-b0, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1433f4d2-b0, col_values=(('qos', UUID('6ba1b6e4-4dbe-476f-b54f-a9b6de13f340')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1433f4d2-b0, col_values=(('external_ids', {'iface-id': '1433f4d2-b02a-474d-9d0e-3e73bb3c2273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c6:29', 'vm-uuid': '67fe80fb-70cc-4242-8e85-0c7adc7052fe'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:49 user nova-compute[75279]: INFO os_vif [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] No VIF found with MAC fa:16:3e:70:c6:29, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-6ed6f001-d5d4-4383-bc36-fd5592c26b07 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.699s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:27:49 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid '0162b017-6a6d-4795-a859-e1a591c5c69b' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid '0162b017-6a6d-4795-a859-e1a591c5c69b' (instance-0000001e)
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] Acquiring lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] No waiting events found dispatching network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:49 user nova-compute[75279]: WARNING nova.compute.manager [req-7cff4927-c34f-450c-9ce2-db838bc75b24 req-e66146d8-6c17-4e50-940e-35672563e416 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received unexpected event network-vif-plugged-7e1799ab-1710-4018-9430-e0b30594c452 for instance with vm_state active and task_state deleting.
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:49 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Took 0.97 seconds to deallocate network for instance.
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:27:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:53 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Deleted allocations for instance 0162b017-6a6d-4795-a859-e1a591c5c69b
Nov 11 00:27:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:53 user nova-compute[75279]: WARNING nova.compute.manager [req-a9090310-fe27-47f0-a2a2-8bb76ef4e7df req-64c62979-68b5-47fe-959c-dc756887bf5e service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state active and task_state resize_finish.
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4b45aecc-a1f3-4d28-9e9c-937b6d8f6975 req-90702555-b17d-48ad-9e60-62f939a74d73 service nova] [instance: 0162b017-6a6d-4795-a859-e1a591c5c69b] Received event network-vif-deleted-7e1799ab-1710-4018-9430-e0b30594c452 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:27:53 user nova-compute[75279]: WARNING nova.compute.manager [req-659dd480-e5f6-450b-ac2b-079718eab56d req-a4f69622-0ab6-4765-a2a7-4b6210b0ede3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state active and task_state resize_finish.
Nov 11 00:27:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=24.92093276977539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:53 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance running successfully.
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Failed to set time: agent not configured {{(pid=75279) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0bc14387-03c0-4ac1-a1fd-7bc1e131b51d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] finish_migration finished successfully. {{(pid=75279) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-d97a2299-4fc3-463a-9ef1-87b4df557098 tempest-SnapshotDataIntegrityTests-1016885518 tempest-SnapshotDataIntegrityTests-1016885518-project-member] Lock "0162b017-6a6d-4795-a859-e1a591c5c69b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.356s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe as it has an incoming, in-progress migration 95c385e8-4b04-4a20-8303-94912eac7c47. Migration status is post-migrating {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:27:53 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating resource usage from migration 95c385e8-4b04-4a20-8303-94912eac7c47
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration 95c385e8-4b04-4a20-8303-94912eac7c47 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:27:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:27:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 2dd490b4-6b20-4579-86c5-1e6b052389aa {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:27:56 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [{"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:27:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-2dd490b4-6b20-4579-86c5-1e6b052389aa" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:27:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:27:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:27:59 user nova-compute[75279]: INFO nova.compute.claims [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Claim successful on node user
Nov 11 00:27:59 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:27:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:28:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.policy [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ed7eabc3874d63bbeca2213be1c743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24163a6c612c4b8c87a3715b8a57fc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:28:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Creating image(s)
Nov 11 00:28:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "/opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "/opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.part --force-share --output=json" returned: 0 in 0.298s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG nova.virt.images [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] 8001da3b-443a-432c-9f09-f1eba77322aa was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.part /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Successfully created port: c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.part /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.converted" returned: 0 in 0.299s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.636s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Successfully updated port: c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.compute.manager [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing instance network info cache due to event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469,backing_fmt=raw /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469,backing_fmt=raw /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk 1073741824" returned: 0 in 0.058s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "9d0c9b2a30fc3eed50d663d052a1be3141c6f469" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance network_info: |[{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Cannot resize image /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Ensure instance console log exists: /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Start _get_guest_xml network_info=[{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T00:27:56Z,direct_url=<?>,disk_format='qcow2',id=8001da3b-443a-432c-9f09-f1eba77322aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1230878534',owner='24163a6c612c4b8c87a3715b8a57fc05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T00:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '8001da3b-443a-432c-9f09-f1eba77322aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:28:02 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:28:02 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-11T00:27:56Z,direct_url=<?>,disk_format='qcow2',id=8001da3b-443a-432c-9f09-f1eba77322aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1230878534',owner='24163a6c612c4b8c87a3715b8a57fc05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-11T00:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1824298663',display_name='tempest-TestMinimumBasicScenario-server-1824298663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1824298663',id=41,image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3bmLl92yfJun+VJyjnXgPmy6wVKGfp2CTTXgANA552N2DrS8EGPtkc4pBYYdD041bL3zBbuwKLU95vBWD67aIlVFck4CBIIWLSFh46QiTgKzsGGhgOGCKACJkNVJdTNw==',key_name='tempest-TestMinimumBasicScenario-1177857801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-4qk09nbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:28:00Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=a6fc9f7a-7754-48ff-b82f-d8da5e463b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'pci_devices' on Instance uuid a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:28:02 user nova-compute[75279]:   <uuid>a6fc9f7a-7754-48ff-b82f-d8da5e463b70</uuid>
Nov 11 00:28:02 user nova-compute[75279]:   <name>instance-00000029</name>
Nov 11 00:28:02 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:28:02 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:28:02 user nova-compute[75279]:   <metadata>
Nov 11 00:28:02 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:28:02 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:name>tempest-TestMinimumBasicScenario-server-1824298663</nova:name>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:28:02</nova:creationTime>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:28:02 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:28:02 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:owner>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:user uuid="d7ed7eabc3874d63bbeca2213be1c743">tempest-TestMinimumBasicScenario-978603383-project-member</nova:user>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:project uuid="24163a6c612c4b8c87a3715b8a57fc05">tempest-TestMinimumBasicScenario-978603383</nova:project>
Nov 11 00:28:02 user nova-compute[75279]:       </nova:owner>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:root type="image" uuid="8001da3b-443a-432c-9f09-f1eba77322aa"/>
Nov 11 00:28:02 user nova-compute[75279]:       <nova:ports>
Nov 11 00:28:02 user nova-compute[75279]:         <nova:port uuid="c38edd40-b3cf-4904-aead-2abb110060ad">
Nov 11 00:28:02 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 11 00:28:02 user nova-compute[75279]:         </nova:port>
Nov 11 00:28:02 user nova-compute[75279]:       </nova:ports>
Nov 11 00:28:02 user nova-compute[75279]:     </nova:instance>
Nov 11 00:28:02 user nova-compute[75279]:   </metadata>
Nov 11 00:28:02 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:28:02 user nova-compute[75279]:     <system>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="serial">a6fc9f7a-7754-48ff-b82f-d8da5e463b70</entry>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="uuid">a6fc9f7a-7754-48ff-b82f-d8da5e463b70</entry>
Nov 11 00:28:02 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:28:02 user nova-compute[75279]:     </system>
Nov 11 00:28:02 user nova-compute[75279]:   </sysinfo>
Nov 11 00:28:02 user nova-compute[75279]:   <os>
Nov 11 00:28:02 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:28:02 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:28:02 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:28:02 user nova-compute[75279]:   </os>
Nov 11 00:28:02 user nova-compute[75279]:   <features>
Nov 11 00:28:02 user nova-compute[75279]:     <acpi/>
Nov 11 00:28:02 user nova-compute[75279]:     <apic/>
Nov 11 00:28:02 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:28:02 user nova-compute[75279]:   </features>
Nov 11 00:28:02 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:28:02 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:28:02 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:28:02 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:28:02 user nova-compute[75279]:   </clock>
Nov 11 00:28:02 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:28:02 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:28:02 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:28:02 user nova-compute[75279]:   </cpu>
Nov 11 00:28:02 user nova-compute[75279]:   <devices>
Nov 11 00:28:02 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:28:02 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:28:02 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk"/>
Nov 11 00:28:02 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:28:02 user nova-compute[75279]:     </disk>
Nov 11 00:28:02 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:28:02 user nova-compute[75279]:       <mac address="fa:16:3e:bd:b8:12"/>
Nov 11 00:28:02 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:28:02 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:28:02 user nova-compute[75279]:       <target dev="tapc38edd40-b3"/>
Nov 11 00:28:02 user nova-compute[75279]:     </interface>
Nov 11 00:28:02 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:28:02 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/console.log" append="off"/>
Nov 11 00:28:02 user nova-compute[75279]:     </serial>
Nov 11 00:28:02 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:28:02 user nova-compute[75279]:     <video>
Nov 11 00:28:02 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:28:02 user nova-compute[75279]:     </video>
Nov 11 00:28:02 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:28:02 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:28:02 user nova-compute[75279]:     </rng>
Nov 11 00:28:02 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:28:02 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:28:02 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:28:02 user nova-compute[75279]:     </memballoon>
Nov 11 00:28:02 user nova-compute[75279]:   </devices>
Nov 11 00:28:02 user nova-compute[75279]: </domain>
Nov 11 00:28:02 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1824298663',display_name='tempest-TestMinimumBasicScenario-server-1824298663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1824298663',id=41,image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3bmLl92yfJun+VJyjnXgPmy6wVKGfp2CTTXgANA552N2DrS8EGPtkc4pBYYdD041bL3zBbuwKLU95vBWD67aIlVFck4CBIIWLSFh46QiTgKzsGGhgOGCKACJkNVJdTNw==',key_name='tempest-TestMinimumBasicScenario-1177857801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-4qk09nbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:28:00Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=a6fc9f7a-7754-48ff-b82f-d8da5e463b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG os_vif [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adfebbaa-08bd-597f-aff3-51d5b4d77fbf', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc38edd40-b3, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc38edd40-b3, col_values=(('qos', UUID('60de46cb-b314-4e38-9ea0-6e3cc8ad523f')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc38edd40-b3, col_values=(('external_ids', {'iface-id': 'c38edd40-b3cf-4904-aead-2abb110060ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:b8:12', 'vm-uuid': 'a6fc9f7a-7754-48ff-b82f-d8da5e463b70'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:02 user nova-compute[75279]: INFO os_vif [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3')
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated VIF entry in instance network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9c6d95c3-3cc0-405e-b0eb-53db6eed2615 req-94aac513-480c-4b40-a68e-0ab28a8ff4ee service nova] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:28:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No VIF found with MAC fa:16:3e:bd:b8:12, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG nova.compute.manager [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:28:04 user nova-compute[75279]: WARNING nova.compute.manager [req-31f222c2-396e-4ec6-9507-3656c1f34506 req-2c85fef2-d180-41f6-9d4e-69e604146e95 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state building and task_state spawning.
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:28:06 user nova-compute[75279]: WARNING nova.compute.manager [req-9eaad70b-90c9-443e-9b9a-d298b56ab5b2 req-f1c8290e-c369-4d62-af2f-f8507b8ebcf8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state building and task_state spawning.
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:28:06 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance spawned successfully.
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:28:07 user nova-compute[75279]: INFO nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 11 00:28:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:28:07 user nova-compute[75279]: INFO nova.compute.manager [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Took 7.49 seconds to build instance.
Nov 11 00:28:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b07cf5c-9835-4d61-b681-aed1f58f9c1b tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.633s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:42 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:44 user nova-compute[75279]: INFO nova.compute.manager [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Terminating instance
Nov 11 00:28:44 user nova-compute[75279]: DEBUG nova.compute.manager [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-unplugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] No waiting events found dispatching network-vif-unplugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-182a5772-9e86-40fb-9073-90ccaa05dbed req-e6f0e639-1fb4-41cf-87f0-9c894de44221 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-unplugged-84ed19da-6587-4c36-9c97-8ce7e4607dae for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Instance destroyed successfully.
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lazy-loading 'resources' on Instance uuid 2dd490b4-6b20-4579-86c5-1e6b052389aa {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424122669',display_name='tempest-ServersNegativeTestJSON-server-1424122669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424122669',id=33,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:19:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf03d05069cd4066b9aa46cbc7eddc9b',ramdisk_id='',reservation_id='r-sbqut8is',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1846058883',owner_user_name='tempest-ServersNegativeTestJSON-1846058883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:19:29Z,user_data=None,user_id='aef74e99ceba4defaecccad87c1bb56c',uuid=2dd490b4-6b20-4579-86c5-1e6b052389aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converting VIF {"id": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "address": "fa:16:3e:1e:a7:c0", "network": {"id": "76275960-acae-4f68-9504-7f0e55861887", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1864405884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf03d05069cd4066b9aa46cbc7eddc9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ed19da-65", "ovs_interfaceid": "84ed19da-6587-4c36-9c97-8ce7e4607dae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG os_vif [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84ed19da-65, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27dbfcab-acbf-449f-b336-492923e99d18) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:28:45 user nova-compute[75279]: INFO os_vif [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a7:c0,bridge_name='br-int',has_traffic_filtering=True,id=84ed19da-6587-4c36-9c97-8ce7e4607dae,network=Network(76275960-acae-4f68-9504-7f0e55861887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ed19da-65')
Nov 11 00:28:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Deleting instance files /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa_del
Nov 11 00:28:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Deletion of /opt/stack/data/nova/instances/2dd490b4-6b20-4579-86c5-1e6b052389aa_del complete
Nov 11 00:28:45 user nova-compute[75279]: INFO nova.compute.manager [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 11 00:28:45 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:28:45 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:46 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Took 0.86 seconds to deallocate network for instance.
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-2a3d6df1-f8ea-4ab8-a2d5-74290d317ca3 req-2bd1d6e0-ccae-4465-b980-9a2b7efba094 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-deleted-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:46 user nova-compute[75279]: INFO nova.compute.manager [req-2a3d6df1-f8ea-4ab8-a2d5-74290d317ca3 req-2bd1d6e0-ccae-4465-b980-9a2b7efba094 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Neutron deleted interface 84ed19da-6587-4c36-9c97-8ce7e4607dae; detaching it from the instance and deleting it from the info cache
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.network.neutron [req-2a3d6df1-f8ea-4ab8-a2d5-74290d317ca3 req-2bd1d6e0-ccae-4465-b980-9a2b7efba094 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.compute.manager [req-2a3d6df1-f8ea-4ab8-a2d5-74290d317ca3 req-2bd1d6e0-ccae-4465-b980-9a2b7efba094 service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Detach interface failed, port_id=84ed19da-6587-4c36-9c97-8ce7e4607dae, reason: Instance 2dd490b4-6b20-4579-86c5-1e6b052389aa could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:28:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:46 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Deleted allocations for instance 2dd490b4-6b20-4579-86c5-1e6b052389aa
Nov 11 00:28:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-37ccccdf-1d66-4b1b-88b6-9c1518845b7f tempest-ServersNegativeTestJSON-1846058883 tempest-ServersNegativeTestJSON-1846058883-project-member] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:28:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] Acquiring lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] Lock "2dd490b4-6b20-4579-86c5-1e6b052389aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:47 user nova-compute[75279]: DEBUG nova.compute.manager [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] No waiting events found dispatching network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:28:47 user nova-compute[75279]: WARNING nova.compute.manager [req-da700d65-4140-4694-bf7a-444f8d6ca43a req-eb1a34f3-ab05-4aa4-baf4-630c07147aac service nova] [instance: 2dd490b4-6b20-4579-86c5-1e6b052389aa] Received unexpected event network-vif-plugged-84ed19da-6587-4c36-9c97-8ce7e4607dae for instance with vm_state deleted and task_state None.
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:28:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:28:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:28:51 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:28:51 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8351MB free_disk=25.011646270751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Applying migration context for instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe as it has an incoming, in-progress migration 95c385e8-4b04-4a20-8303-94912eac7c47. Migration status is finished {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 11 00:28:51 user nova-compute[75279]: INFO nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating resource usage from migration 95c385e8-4b04-4a20-8303-94912eac7c47
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Migration 95c385e8-4b04-4a20-8303-94912eac7c47 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:28:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:28:53 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:53 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:53 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:28:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Port 1433f4d2-b02a-474d-9d0e-3e73bb3c2273 binding to destination host user is already ACTIVE {{(pid=75279) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Creating tmpfile /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/tmp68f8w_la to verify with other compute node that the instance is on the same shared storage. {{(pid=75279) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:14 user nova-compute[75279]: WARNING nova.compute.manager [req-c4738799-1c9b-43bf-8a5e-40d781f27661 req-0598e94e-e1c4-4ee4-9015-c3da1c100d29 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance destroyed successfully.
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'resources' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:27:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1433f4d2-b0, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba1b6e4-4dbe-476f-b54f-a9b6de13f340) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:15 user nova-compute[75279]: INFO os_vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:29:15 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a08255-a7b3-4687-b1f4-8ccccbe826b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:29:15 user nova-compute[75279]: No targets found.
Nov 11 00:29:15 user nova-compute[75279]: iSNS:
Nov 11 00:29:15 user nova-compute[75279]: No targets found.
Nov 11 00:29:15 user nova-compute[75279]: STATIC:
Nov 11 00:29:15 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e
Nov 11 00:29:15 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:29:15 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:29:15 user nova-compute[75279]: FIRMWARE:
Nov 11 00:29:15 user nova-compute[75279]: No targets found.
Nov 11 00:29:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:29:15 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:29:15 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6113ae2-9f55-46ff-a656-31f07e67fa58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f01f5-92bd-4a86-b59b-09a561876768]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:29:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:29:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e01a0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f260f-0624-4fc3-a8e9-4d073858a223]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3557774-1d0c-40f3-b73e-bfd546fc4ba1]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f1fe94-a170-4217-9388-b3218d92e2f1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091c067-0e41-4075-98e3-de80d2c56acc]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[42149de9-1169-4c0e-a512-7fe146353f7f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8c1e37-c754-4777-8d45-3e30c2a2e596]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:29:15 user nova-compute[75279]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:29:15 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a06c57-e83c-4fd2-a9c3-97c1c8fd6c5e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== disconnect_volume: return (320ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:16 user nova-compute[75279]: WARNING nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:16 user nova-compute[75279]: WARNING nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:16 user nova-compute[75279]: WARNING nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:16 user nova-compute[75279]: WARNING nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:16 user nova-compute[75279]: WARNING nova.compute.manager [req-78e7390e-d282-4691-99f1-238b5cd8bafb req-746e0209-1fed-4690-b9ca-34b3655c0a58 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:29:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'migration_context' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.objects.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Object Instance<67fe80fb-70cc-4242-8e85-0c7adc7052fe> lazy-loaded attributes: resources,migration_context {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.313s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:24 user nova-compute[75279]: INFO nova.compute.manager [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Swapping old allocation on dict_keys(['d9002de1-9e35-4b13-abf3-b4c27ac7a991']) held by migration 95c385e8-4b04-4a20-8303-94912eac7c47 for instance
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Overwriting current allocation {'allocations': {'d9002de1-9e35-4b13-abf3-b4c27ac7a991': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 50}}, 'project_id': 'dfd67c528cc14ba9ad1a6143a942841e', 'user_id': '45b9a76c019d4cc4a63342f70b6209ca', 'consumer_generation': 1} on consumer 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:29:24 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG nova.network.neutron [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbe83b5-fe60-4a34-be97-e0fc8d2e705a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9221eadb-33ef-4d59-b6a4-a623f03a1374]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7ab479-3101-4049-9612-9372d5e46654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d6eb2-06e2-4fe3-a702-b1a2a8e04e02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:29:25 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:29:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce80f86-62c4-4193-9e6e-eed43b1d97a7]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:29:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:29:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:29 user nova-compute[75279]: INFO nova.compute.manager [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Terminating instance
Nov 11 00:29:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f259715-2d72-4e5e-af0a-4bf5172b6fd8 req-58e02508-a6e4-4c00-af9d-30025a244e33 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-unplugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:29:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Instance destroyed successfully.
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lazy-loading 'resources' on Instance uuid 7208334b-eb49-4a4c-9e18-0fe1c47ce527 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416518736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416518736',id=39,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsSb/hzawTFebWFUg3MAGqU40aFPIZS4+y4VrLfhMeNnHnSEJGUtvY5WHZBH62XeEJ/hnX8x1KBNWQpk9r5UqPOzN7exP2k8CGHtj0CyIzrGVGoWKaGuLYeAhvvsMpUqg==',key_name='tempest-keypair-1037782947',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae778b46b71f4d1db8fce5694256ebb9',ramdisk_id='',reservation_id='r-4rdldr5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-174044347',owner_user_name='tempest-AttachVolumeShelveTestJSON-174044347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93f7498f8558443eab6afb03331bc6aa',uuid=7208334b-eb49-4a4c-9e18-0fe1c47ce527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converting VIF {"id": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "address": "fa:16:3e:27:0a:d5", "network": {"id": "7aa7e2d4-09b9-44c3-9ac9-24ed479593b0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-917152107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae778b46b71f4d1db8fce5694256ebb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c623af-4c", "ovs_interfaceid": "d2c623af-4c0d-4784-82e9-4a39fa91b705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG os_vif [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2c623af-4c, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e718d090-a4a3-4984-827b-f26f54bbf932) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:30 user nova-compute[75279]: INFO os_vif [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0a:d5,bridge_name='br-int',has_traffic_filtering=True,id=d2c623af-4c0d-4784-82e9-4a39fa91b705,network=Network(7aa7e2d4-09b9-44c3-9ac9-24ed479593b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c623af-4c')
Nov 11 00:29:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Deleting instance files /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527_del
Nov 11 00:29:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Deletion of /opt/stack/data/nova/instances/7208334b-eb49-4a4c-9e18-0fe1c47ce527_del complete
Nov 11 00:29:30 user nova-compute[75279]: INFO nova.compute.manager [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 11 00:29:30 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:29:30 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:29:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] Acquiring lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] No waiting events found dispatching network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:32 user nova-compute[75279]: WARNING nova.compute.manager [req-65312e51-9a71-4e46-9091-e42c89d8c987 req-2b1d3b94-1333-4c37-8be9-4c49001e2280 service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received unexpected event network-vif-plugged-d2c623af-4c0d-4784-82e9-4a39fa91b705 for instance with vm_state active and task_state deleting.
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:32 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Took 2.12 seconds to deallocate network for instance.
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-20cc899c-83a4-49a4-946b-ad1b9ce8b8bc req-f11d8804-4da5-4baa-9ff8-4c3f0949e1ac service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Received event network-vif-deleted-d2c623af-4c0d-4784-82e9-4a39fa91b705 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:32 user nova-compute[75279]: INFO nova.compute.manager [req-20cc899c-83a4-49a4-946b-ad1b9ce8b8bc req-f11d8804-4da5-4baa-9ff8-4c3f0949e1ac service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Neutron deleted interface d2c623af-4c0d-4784-82e9-4a39fa91b705; detaching it from the instance and deleting it from the info cache
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-20cc899c-83a4-49a4-946b-ad1b9ce8b8bc req-f11d8804-4da5-4baa-9ff8-4c3f0949e1ac service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-20cc899c-83a4-49a4-946b-ad1b9ce8b8bc req-f11d8804-4da5-4baa-9ff8-4c3f0949e1ac service nova] [instance: 7208334b-eb49-4a4c-9e18-0fe1c47ce527] Detach interface failed, port_id=d2c623af-4c0d-4784-82e9-4a39fa91b705, reason: Instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:32 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Deleted allocations for instance 7208334b-eb49-4a4c-9e18-0fe1c47ce527
Nov 11 00:29:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e99d5fb3-3e53-4bd3-b583-bafd75eee0d9 tempest-AttachVolumeShelveTestJSON-174044347 tempest-AttachVolumeShelveTestJSON-174044347-project-member] Lock "7208334b-eb49-4a4c-9e18-0fe1c47ce527" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:43 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:29:46 user nova-compute[75279]: INFO nova.compute.claims [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Claim successful on node user
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:29:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.policy [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229718c9f2aa4e03bb70e628240f7c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d10db719f88417e94bf0031ba64a051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:29:46 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Creating image(s)
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "/opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "/opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "/opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Successfully created port: 26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk 1073741824" returned: 0 in 0.054s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Cannot resize image /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Ensure instance console log exists: /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Successfully updated port: 26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquired lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-changed-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Refreshing instance network info cache due to event network-changed-26e2b0fd-c26a-4ef5-a131-89949a669dc2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] Acquiring lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Updating instance_info_cache with network_info: [{"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Releasing lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Instance network_info: |[{"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] Acquired lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Refreshing network info cache for port 26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Start _get_guest_xml network_info=[{"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:29:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:48 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1656084650',display_name='tempest-VolumesActionsTest-instance-1656084650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1656084650',id=42,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d10db719f88417e94bf0031ba64a051',ramdisk_id='',reservation_id='r-6ifnstl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1006138581',owner_user_name='tempest-VolumesActionsTest-1006138581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:29:47Z,user_data=None,user_id='229718c9f2aa4e03bb70e628240f7c2b',uuid=e38beaee-b185-4d30-8a0c-174f55472277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converting VIF {"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.objects.instance [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lazy-loading 'pci_devices' on Instance uuid e38beaee-b185-4d30-8a0c-174f55472277 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:29:48 user nova-compute[75279]:   <uuid>e38beaee-b185-4d30-8a0c-174f55472277</uuid>
Nov 11 00:29:48 user nova-compute[75279]:   <name>instance-0000002a</name>
Nov 11 00:29:48 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:29:48 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:29:48 user nova-compute[75279]:   <metadata>
Nov 11 00:29:48 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:29:48 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:name>tempest-VolumesActionsTest-instance-1656084650</nova:name>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:29:48</nova:creationTime>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:29:48 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:29:48 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:owner>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:user uuid="229718c9f2aa4e03bb70e628240f7c2b">tempest-VolumesActionsTest-1006138581-project-member</nova:user>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:project uuid="2d10db719f88417e94bf0031ba64a051">tempest-VolumesActionsTest-1006138581</nova:project>
Nov 11 00:29:48 user nova-compute[75279]:       </nova:owner>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:29:48 user nova-compute[75279]:       <nova:ports>
Nov 11 00:29:48 user nova-compute[75279]:         <nova:port uuid="26e2b0fd-c26a-4ef5-a131-89949a669dc2">
Nov 11 00:29:48 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:29:48 user nova-compute[75279]:         </nova:port>
Nov 11 00:29:48 user nova-compute[75279]:       </nova:ports>
Nov 11 00:29:48 user nova-compute[75279]:     </nova:instance>
Nov 11 00:29:48 user nova-compute[75279]:   </metadata>
Nov 11 00:29:48 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:29:48 user nova-compute[75279]:     <system>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="serial">e38beaee-b185-4d30-8a0c-174f55472277</entry>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="uuid">e38beaee-b185-4d30-8a0c-174f55472277</entry>
Nov 11 00:29:48 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:29:48 user nova-compute[75279]:     </system>
Nov 11 00:29:48 user nova-compute[75279]:   </sysinfo>
Nov 11 00:29:48 user nova-compute[75279]:   <os>
Nov 11 00:29:48 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:29:48 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:29:48 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:29:48 user nova-compute[75279]:   </os>
Nov 11 00:29:48 user nova-compute[75279]:   <features>
Nov 11 00:29:48 user nova-compute[75279]:     <acpi/>
Nov 11 00:29:48 user nova-compute[75279]:     <apic/>
Nov 11 00:29:48 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:29:48 user nova-compute[75279]:   </features>
Nov 11 00:29:48 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:29:48 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:29:48 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:29:48 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:29:48 user nova-compute[75279]:   </clock>
Nov 11 00:29:48 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:29:48 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:29:48 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:29:48 user nova-compute[75279]:   </cpu>
Nov 11 00:29:48 user nova-compute[75279]:   <devices>
Nov 11 00:29:48 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:29:48 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:29:48 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk"/>
Nov 11 00:29:48 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:29:48 user nova-compute[75279]:     </disk>
Nov 11 00:29:48 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:29:48 user nova-compute[75279]:       <mac address="fa:16:3e:6e:2b:72"/>
Nov 11 00:29:48 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:29:48 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:29:48 user nova-compute[75279]:       <target dev="tap26e2b0fd-c2"/>
Nov 11 00:29:48 user nova-compute[75279]:     </interface>
Nov 11 00:29:48 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:29:48 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/console.log" append="off"/>
Nov 11 00:29:48 user nova-compute[75279]:     </serial>
Nov 11 00:29:48 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:29:48 user nova-compute[75279]:     <video>
Nov 11 00:29:48 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:29:48 user nova-compute[75279]:     </video>
Nov 11 00:29:48 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:29:48 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:29:48 user nova-compute[75279]:     </rng>
Nov 11 00:29:48 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:29:48 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:29:48 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:29:48 user nova-compute[75279]:     </memballoon>
Nov 11 00:29:48 user nova-compute[75279]:   </devices>
Nov 11 00:29:48 user nova-compute[75279]: </domain>
Nov 11 00:29:48 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1656084650',display_name='tempest-VolumesActionsTest-instance-1656084650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1656084650',id=42,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d10db719f88417e94bf0031ba64a051',ramdisk_id='',reservation_id='r-6ifnstl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1006138581',owner_user_name='tempest-VolumesActionsTest-1006138581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:29:47Z,user_data=None,user_id='229718c9f2aa4e03bb70e628240f7c2b',uuid=e38beaee-b185-4d30-8a0c-174f55472277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converting VIF {"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG os_vif [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7eb0736-44ad-59d5-a0df-59e369a430a9', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e2b0fd-c2, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26e2b0fd-c2, col_values=(('qos', UUID('b847bec2-0338-4d9f-b6c0-8631415a6484')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26e2b0fd-c2, col_values=(('external_ids', {'iface-id': '26e2b0fd-c26a-4ef5-a131-89949a669dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2b:72', 'vm-uuid': 'e38beaee-b185-4d30-8a0c-174f55472277'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:48 user nova-compute[75279]: INFO os_vif [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2')
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] No VIF found with MAC fa:16:3e:6e:2b:72, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Updated VIF entry in instance network info cache for port 26e2b0fd-c26a-4ef5-a131-89949a669dc2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Updating instance_info_cache with network_info: [{"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:29:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-038eec7a-6ec9-4132-9cde-21d74019451e req-63cac3fc-632f-48a3-81ed-b6bf89cbfdc5 service nova] Releasing lock "refresh_cache-e38beaee-b185-4d30-8a0c-174f55472277" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG nova.compute.manager [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] No waiting events found dispatching network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:50 user nova-compute[75279]: WARNING nova.compute.manager [req-f5576f27-4757-475e-b9f8-b3a6f7f5fe52 req-8797ad84-4e3a-43a3-ab8d-e5fd44f04c97 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received unexpected event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 for instance with vm_state building and task_state spawning.
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:52 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:52 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=25.02725601196289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e38beaee-b185-4d30-8a0c-174f55472277 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] No waiting events found dispatching network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:29:52 user nova-compute[75279]: WARNING nova.compute.manager [req-36c7f368-3e28-4471-95d0-e195238d491f req-ef3e3c29-dc6f-45be-9f62-75cc82208d3e service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received unexpected event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 for instance with vm_state building and task_state spawning.
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:29:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Instance spawned successfully.
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:29:52 user nova-compute[75279]: INFO nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 11 00:29:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:29:52 user nova-compute[75279]: INFO nova.compute.manager [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Took 6.67 seconds to build instance.
Nov 11 00:29:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-809b5295-75ce-44d8-969f-45b3033fffaf tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.763s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:29:55 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:29:57 user nova-compute[75279]: INFO nova.compute.manager [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Attaching volume 52263a53-226c-404d-8c38-7899514bfef1 to /dev/vdb
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.utils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e94674a-44cf-41bc-8ed2-8d3eae7bc158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61a323-d068-4f26-b5b5-c34da03b9525]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3eca61-5df7-4433-bf21-d942bf99aac8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d699d0-fcde-47d2-9864-992a28960d07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:29:57 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:29:57 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad577d0d-7a27-4d3b-9b24-2dd085c2c500]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG os_brick.utils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:29:57 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating existing volume attachment record: 33d2b536-5ad0-4a3e-bb1a-18eefe4830fd {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Starting finish_revert_migration {{(pid=75279) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start _get_guest_xml network_info=[{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '67fe80fb-70cc-4242-8e85-0c7adc7052fe', 'attached_at': '2023-11-11T00:29:58.000000', 'detached_at': '', 'volume_id': '46d95553-6760-45d7-a227-2eeb6f56b46e', 'serial': '46d95553-6760-45d7-a227-2eeb6f56b46e'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '4644dfea-18bd-4f6e-80b9-cff7f3df8bce', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:29:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.objects.instance [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:29:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:29:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:29:58 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a510ca90-c9cb-4e1c-a9b0-f67949f44c5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:29:58 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2e421-daaf-4fd5-837e-504562cb743e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e] added
Nov 11 00:29:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e94db1b-530e-4bdc-bab9-7883527c2d04]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1e125-d8bb-41f4-a915-ea4cb2cd0fc7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtknhSis" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b267a5d-35e2-4ed0-8bdf-35b765045376]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NtknhSis'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.101s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa7358b-cbcc-44f7-8aa2-b3abe830ede3]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b10273-9178-4efc-914f-2cb01b4af5ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:29:58 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:29:58 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:29:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:29:58 user nova-compute[75279]: 
Nov 11 00:29:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167494c-4fc1-4167-ac28-d067da51e8bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:29:58 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:29:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770b264-f5a4-451b-a20d-d1bdfbc30cdb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3d8ec-06fb-4b42-ba3b-450efd3e7f70]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:29:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:29:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd1bb2-195e-4103-b3de-f11ad905c8a6]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:29:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323064393132', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:27:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:29:59 user nova-compute[75279]:   <uuid>67fe80fb-70cc-4242-8e85-0c7adc7052fe</uuid>
Nov 11 00:29:59 user nova-compute[75279]:   <name>instance-00000025</name>
Nov 11 00:29:59 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:29:59 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:29:59 user nova-compute[75279]:   <metadata>
Nov 11 00:29:59 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:29:59 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:name>tempest-ServerActionsTestOtherB-server-1101090786</nova:name>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:29:58</nova:creationTime>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:29:59 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:29:59 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:owner>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:user uuid="45b9a76c019d4cc4a63342f70b6209ca">tempest-ServerActionsTestOtherB-720451106-project-member</nova:user>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:project uuid="dfd67c528cc14ba9ad1a6143a942841e">tempest-ServerActionsTestOtherB-720451106</nova:project>
Nov 11 00:29:59 user nova-compute[75279]:       </nova:owner>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:29:59 user nova-compute[75279]:       <nova:ports>
Nov 11 00:29:59 user nova-compute[75279]:         <nova:port uuid="1433f4d2-b02a-474d-9d0e-3e73bb3c2273">
Nov 11 00:29:59 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 11 00:29:59 user nova-compute[75279]:         </nova:port>
Nov 11 00:29:59 user nova-compute[75279]:       </nova:ports>
Nov 11 00:29:59 user nova-compute[75279]:     </nova:instance>
Nov 11 00:29:59 user nova-compute[75279]:   </metadata>
Nov 11 00:29:59 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:29:59 user nova-compute[75279]:     <system>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="serial">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="uuid">67fe80fb-70cc-4242-8e85-0c7adc7052fe</entry>
Nov 11 00:29:59 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:29:59 user nova-compute[75279]:     </system>
Nov 11 00:29:59 user nova-compute[75279]:   </sysinfo>
Nov 11 00:29:59 user nova-compute[75279]:   <os>
Nov 11 00:29:59 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:29:59 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:29:59 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:29:59 user nova-compute[75279]:   </os>
Nov 11 00:29:59 user nova-compute[75279]:   <features>
Nov 11 00:29:59 user nova-compute[75279]:     <acpi/>
Nov 11 00:29:59 user nova-compute[75279]:     <apic/>
Nov 11 00:29:59 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:29:59 user nova-compute[75279]:   </features>
Nov 11 00:29:59 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:29:59 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:29:59 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:29:59 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:29:59 user nova-compute[75279]:   </clock>
Nov 11 00:29:59 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:29:59 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:29:59 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:29:59 user nova-compute[75279]:   </cpu>
Nov 11 00:29:59 user nova-compute[75279]:   <devices>
Nov 11 00:29:59 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:29:59 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:29:59 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk"/>
Nov 11 00:29:59 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:29:59 user nova-compute[75279]:     </disk>
Nov 11 00:29:59 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:29:59 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:29:59 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:29:59 user nova-compute[75279]:       <target dev="vdb" bus="virtio"/>
Nov 11 00:29:59 user nova-compute[75279]:       <serial>46d95553-6760-45d7-a227-2eeb6f56b46e</serial>
Nov 11 00:29:59 user nova-compute[75279]:     </disk>
Nov 11 00:29:59 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:29:59 user nova-compute[75279]:       <mac address="fa:16:3e:70:c6:29"/>
Nov 11 00:29:59 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:29:59 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:29:59 user nova-compute[75279]:       <target dev="tap1433f4d2-b0"/>
Nov 11 00:29:59 user nova-compute[75279]:     </interface>
Nov 11 00:29:59 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:29:59 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/console.log" append="off"/>
Nov 11 00:29:59 user nova-compute[75279]:     </serial>
Nov 11 00:29:59 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:29:59 user nova-compute[75279]:     <video>
Nov 11 00:29:59 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:29:59 user nova-compute[75279]:     </video>
Nov 11 00:29:59 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:29:59 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:29:59 user nova-compute[75279]:     </rng>
Nov 11 00:29:59 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:29:59 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:29:59 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:29:59 user nova-compute[75279]:     </memballoon>
Nov 11 00:29:59 user nova-compute[75279]:   </devices>
Nov 11 00:29:59 user nova-compute[75279]: </domain>
Nov 11 00:29:59 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:27:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG os_vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b4cd6c-863c-5557-abea-65f885c17433', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1433f4d2-b0, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1433f4d2-b0, col_values=(('qos', UUID('89d87f1d-89db-4930-a957-0cab887afb7c')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1433f4d2-b0, col_values=(('external_ids', {'iface-id': '1433f4d2-b02a-474d-9d0e-3e73bb3c2273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c6:29', 'vm-uuid': '67fe80fb-70cc-4242-8e85-0c7adc7052fe'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:29:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:29:59 user nova-compute[75279]: INFO os_vif [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:30:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:01 user nova-compute[75279]: WARNING nova.compute.manager [req-0efc3466-c32f-4f3c-aa8f-c998794f00a4 req-0d2f8f08-23d5-4fce-867d-5ca9340aef5b service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:30:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:30:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance running successfully.
Nov 11 00:30:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] finish_revert_migration finished successfully. {{(pid=75279) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:03 user nova-compute[75279]: DEBUG nova.compute.manager [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:03 user nova-compute[75279]: WARNING nova.compute.manager [req-3fc4e5fc-bb7a-45d8-8f3d-e9129fb73247 req-e69420b7-baf3-439a-94b8-d0f6d854db2a service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state resized and task_state resize_reverting.
Nov 11 00:30:03 user nova-compute[75279]: INFO nova.compute.manager [None req-2baeeaa6-fa79-40c7-8495-1a73425df26d tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance to original state: 'active'
Nov 11 00:30:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxynovja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:30:37 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:30:37 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:30:37 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc00d24-a371-4279-b9cf-ddc80106efcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:30:37 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc2e9ae-9e1f-476d-86de-169bdebfb686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1] added
Nov 11 00:30:37 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.186s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c05ad8-1270-49d4-b34c-714ff9eadfd4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ae5a7-43bc-480b-8df0-3f03548e2426]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxynovja {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxynovja" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade260b6-85ef-46ca-b301-421d2148ad8c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxynovja'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8add3f7-465d-4705-8d69-91399fb83322]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84a2f7-cd90-4e9e-9762-50804f5b9e59]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:30:37 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:30:37 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:30:37 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[986f4d7a-0214-458f-85c0-f27ce02e033e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260]
Nov 11 00:30:38 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260] successful.
Nov 11 00:30:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab201c-87df-43cf-9ecd-0a7394bd332d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec4ca2-e8a2-43a7-9699-a67c69554b42]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:30:38 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:30:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:30:38 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:30:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45688663-d518-4629-9a5d-f378f6c25433]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:30:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxynovja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23430343063626335', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430343063626335', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.objects.instance [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:30:39 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:30:39 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:30:39 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:30:39 user nova-compute[75279]:   <serial>52263a53-226c-404d-8c38-7899514bfef1</serial>
Nov 11 00:30:39 user nova-compute[75279]: </disk>
Nov 11 00:30:39 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] No VIF found with MAC fa:16:3e:bd:b8:12, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-5c031498-251d-4b51-95aa-c646e55f9b13 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.127s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:30:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:30:41 user nova-compute[75279]: INFO nova.compute.claims [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Claim successful on node user
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:30:41 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.policy [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e43e7d099fa43da83e809afdbcc5f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf96673db9e40f4ad85ec0b13205621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:30:41 user nova-compute[75279]: INFO nova.virt.block_device [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Booting with volume ecece15e-77f7-42e1-85e9-cd4a7178e884 at /dev/vda
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.utils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd263c-38ab-46ee-be66-b5cd05ba2726]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0ccb8-bf52-4455-91a6-94f5434aeb6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5cb165-3a6a-4093-a428-f17d34d40701]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d738844-c545-448a-be73-0c917ea8532c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:30:41 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:30:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dd260-d979-49be-96eb-67b555ab369d]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG os_brick.utils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:30:41 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating existing volume attachment record: 8711df96-f075-4ecb-a1e1-fc43732eb53b {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Successfully created port: 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing instance network info cache due to event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:30:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Successfully updated port: 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing instance network info cache due to event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance network_info: |[{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated VIF entry in instance network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b56b1148-7148-4393-8e20-e5d7ed47b4d4 req-34f73ba0-c355-4bd2-a696-3191a7e60367 service nova] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated VIF entry in instance network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG nova.network.neutron [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7873106c-7d5d-4320-b2d9-bc032d4b0c65 req-a553c4fa-35f7-4d64-af71-4f4bcc57340d service nova] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing instance network info cache due to event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated VIF entry in instance network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG nova.network.neutron [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4eca68bc-fd2d-40b9-a46f-2286c3b48105 req-df74b4cb-ec8d-4466-8367-b6cc0b219d53 service nova] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:45 user nova-compute[75279]: INFO nova.compute.manager [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Rebooting instance
Nov 11 00:30:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:46 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:46 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:30:47 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:47 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:30:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:49 user nova-compute[75279]: WARNING nova.compute.manager [req-570d65c3-a9ca-4fd4-acaa-4593f7e3c6bb req-0a7fa390-ff9f-4ae9-8d78-3f24c81e2a49 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state active and task_state reboot_started.
Nov 11 00:30:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:50 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance shutdown successfully.
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:51 user nova-compute[75279]: WARNING nova.compute.manager [req-c55fee9b-c33f-4398-a9de-d2d3a506ca1d req-79980287-b064-43a8-9892-ffe4e81dbe40 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state active and task_state reboot_started.
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:30:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:54 user nova-compute[75279]: WARNING nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state active and task_state reboot_started.
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:30:54 user nova-compute[75279]: WARNING nova.compute.manager [req-993c6efe-8746-43f0-b01a-fc64ea450f14 req-e76afaad-ac5d-4a4d-a960-5f0bad346966 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state active and task_state reboot_started.
Nov 11 00:30:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance running successfully.
Nov 11 00:30:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:30:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=25.0140380859375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:30:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance soft rebooted successfully.
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0e4aaa8c-b181-4a1e-8a60-9b94c5d73453 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.347s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e38beaee-b185-4d30-8a0c-174f55472277 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e5650742-ab40-4494-b945-25754f12cc69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:30:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: e5650742-ab40-4494-b945-25754f12cc69] Skipping network cache update for instance because it is Building. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:30:56 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [{"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-67fe80fb-70cc-4242-8e85-0c7adc7052fe" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:30:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:30:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:30:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:30:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:31:08 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Creating image(s)
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Ensure instance console log exists: /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start _get_guest_xml network_info=[{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5650742-ab40-4494-b945-25754f12cc69', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecece15e-77f7-42e1-85e9-cd4a7178e884', 'serial': 'ecece15e-77f7-42e1-85e9-cd4a7178e884'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '8711df96-f075-4ecb-a1e1-fc43732eb53b', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:31:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:31:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:31:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:31:08 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:31:08 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbde8e8-69c4-4f9a-84cc-2bdbf7b305d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:31:08 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91155f25-916e-459b-9319-e78f8ea8bf5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884] added
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba41e0-8e1a-4146-9951-8c4cf1aaf25f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd39534-b433-42a7-b884-f3548b000eb6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aowXPCMu {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aowXPCMu" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16f911-fd83-4efd-a017-bc998b5cf75d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aowXPCMu'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d712e-3561-463d-a88f-1a9c6455b60d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a11c56f-6f12-484b-ba2c-07ec6a9170df]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9abea5-890c-4ccf-a01d-85fa2fd1fab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]
Nov 11 00:31:08 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74468f8a-1503-40c1-9bbc-c5f6ce2e1f7e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb063053-381e-4729-85d8-a0330bc15e73]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:31:08 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b93dff6-cadb-43f2-a5aa-7e7584054b6c]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:31:08 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26631303936363534', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631303936363534', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWxXE+nCpB8oQYGZRBRlf9yZs+lUVgFTMdhvQRwsWSeErfVK9m2x3mxCJ994B7EAnaHWiRtNSn5GgDWnJg5CsVkI/nslLvAx/ycnYq9vi6QqFwb4/IMi2YCy2hZWoMK7Q==',key_name='tempest-TestShelveInstance-731418270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:30:41Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.objects.instance [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'pci_devices' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:31:09 user nova-compute[75279]:   <uuid>e5650742-ab40-4494-b945-25754f12cc69</uuid>
Nov 11 00:31:09 user nova-compute[75279]:   <name>instance-0000002b</name>
Nov 11 00:31:09 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:31:09 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:31:09 user nova-compute[75279]:   <metadata>
Nov 11 00:31:09 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:31:09 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:31:09 user nova-compute[75279]:       <nova:name>tempest-TestShelveInstance-server-967064466</nova:name>
Nov 11 00:31:09 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:31:08</nova:creationTime>
Nov 11 00:31:09 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:31:09 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:31:09 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:31:09 user nova-compute[75279]:       <nova:owner>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:user uuid="7e43e7d099fa43da83e809afdbcc5f03">tempest-TestShelveInstance-86237796-project-member</nova:user>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:project uuid="ddf96673db9e40f4ad85ec0b13205621">tempest-TestShelveInstance-86237796</nova:project>
Nov 11 00:31:09 user nova-compute[75279]:       </nova:owner>
Nov 11 00:31:09 user nova-compute[75279]:       <nova:ports>
Nov 11 00:31:09 user nova-compute[75279]:         <nova:port uuid="8fe3c169-5e73-46ca-85e1-f0004230e2c2">
Nov 11 00:31:09 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:31:09 user nova-compute[75279]:         </nova:port>
Nov 11 00:31:09 user nova-compute[75279]:       </nova:ports>
Nov 11 00:31:09 user nova-compute[75279]:     </nova:instance>
Nov 11 00:31:09 user nova-compute[75279]:   </metadata>
Nov 11 00:31:09 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:31:09 user nova-compute[75279]:     <system>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="serial">e5650742-ab40-4494-b945-25754f12cc69</entry>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="uuid">e5650742-ab40-4494-b945-25754f12cc69</entry>
Nov 11 00:31:09 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:31:09 user nova-compute[75279]:     </system>
Nov 11 00:31:09 user nova-compute[75279]:   </sysinfo>
Nov 11 00:31:09 user nova-compute[75279]:   <os>
Nov 11 00:31:09 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:31:09 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:31:09 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:31:09 user nova-compute[75279]:   </os>
Nov 11 00:31:09 user nova-compute[75279]:   <features>
Nov 11 00:31:09 user nova-compute[75279]:     <acpi/>
Nov 11 00:31:09 user nova-compute[75279]:     <apic/>
Nov 11 00:31:09 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:31:09 user nova-compute[75279]:   </features>
Nov 11 00:31:09 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:31:09 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:31:09 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:31:09 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:31:09 user nova-compute[75279]:   </clock>
Nov 11 00:31:09 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:31:09 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:31:09 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:31:09 user nova-compute[75279]:   </cpu>
Nov 11 00:31:09 user nova-compute[75279]:   <devices>
Nov 11 00:31:09 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:31:09 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:31:09 user nova-compute[75279]:       <source dev="/dev/sdd"/>
Nov 11 00:31:09 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:31:09 user nova-compute[75279]:       <serial>ecece15e-77f7-42e1-85e9-cd4a7178e884</serial>
Nov 11 00:31:09 user nova-compute[75279]:     </disk>
Nov 11 00:31:09 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:31:09 user nova-compute[75279]:       <mac address="fa:16:3e:4a:ac:6d"/>
Nov 11 00:31:09 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:31:09 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:31:09 user nova-compute[75279]:       <target dev="tap8fe3c169-5e"/>
Nov 11 00:31:09 user nova-compute[75279]:     </interface>
Nov 11 00:31:09 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:31:09 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69/console.log" append="off"/>
Nov 11 00:31:09 user nova-compute[75279]:     </serial>
Nov 11 00:31:09 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:31:09 user nova-compute[75279]:     <video>
Nov 11 00:31:09 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:31:09 user nova-compute[75279]:     </video>
Nov 11 00:31:09 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:31:09 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:31:09 user nova-compute[75279]:     </rng>
Nov 11 00:31:09 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:31:09 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:31:09 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:31:09 user nova-compute[75279]:     </memballoon>
Nov 11 00:31:09 user nova-compute[75279]:   </devices>
Nov 11 00:31:09 user nova-compute[75279]: </domain>
Nov 11 00:31:09 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWxXE+nCpB8oQYGZRBRlf9yZs+lUVgFTMdhvQRwsWSeErfVK9m2x3mxCJ994B7EAnaHWiRtNSn5GgDWnJg5CsVkI/nslLvAx/ycnYq9vi6QqFwb4/IMi2YCy2hZWoMK7Q==',key_name='tempest-TestShelveInstance-731418270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:30:41Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG os_vif [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4d44a30-872e-5972-abf1-877ad3b6ce0e', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe3c169-5e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fe3c169-5e, col_values=(('qos', UUID('e46b7d7d-0a25-4fa3-9ba3-ec35f43b9bc3')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fe3c169-5e, col_values=(('external_ids', {'iface-id': '8fe3c169-5e73-46ca-85e1-f0004230e2c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ac:6d', 'vm-uuid': 'e5650742-ab40-4494-b945-25754f12cc69'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:09 user nova-compute[75279]: INFO os_vif [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e')
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:31:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] No VIF found with MAC fa:16:3e:4a:ac:6d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:31:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:31:11 user nova-compute[75279]: WARNING nova.compute.manager [req-1621f01f-be1d-442b-ba79-b48447d0a1f4 req-2493f09d-aeac-434f-ad10-4adb5c13165e service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state building and task_state spawning.
Nov 11 00:31:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:31:13 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance spawned successfully.
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:31:13 user nova-compute[75279]: INFO nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:31:13 user nova-compute[75279]: WARNING nova.compute.manager [req-0d914203-1eb4-48ed-85ec-435f95bef4aa req-78df6a2e-e3f7-4eb0-a43b-9593de7fb248 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state building and task_state spawning.
Nov 11 00:31:13 user nova-compute[75279]: INFO nova.compute.manager [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Took 32.27 seconds to build instance.
Nov 11 00:31:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-44a5c0d1-5641-4e9f-8798-baf05a822bce tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.391s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:31:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:31:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:31:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:31:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:31:54 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=25.002132415771484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e38beaee-b185-4d30-8a0c-174f55472277 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e5650742-ab40-4494-b945-25754f12cc69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:31:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:56 user nova-compute[75279]: INFO nova.compute.manager [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Terminating instance
Nov 11 00:31:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-unplugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] No waiting events found dispatching network-vif-unplugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:31:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-7f1ddb82-3bf7-41c7-b009-a60fe16a7676 req-0a90ce7b-7f85-42fe-96c3-a3abf479ba81 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-unplugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Instance destroyed successfully.
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.objects.instance [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lazy-loading 'resources' on Instance uuid e38beaee-b185-4d30-8a0c-174f55472277 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1656084650',display_name='tempest-VolumesActionsTest-instance-1656084650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1656084650',id=42,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:29:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d10db719f88417e94bf0031ba64a051',ramdisk_id='',reservation_id='r-6ifnstl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1006138581',owner_user_name='tempest-VolumesActionsTest-1006138581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:29:53Z,user_data=None,user_id='229718c9f2aa4e03bb70e628240f7c2b',uuid=e38beaee-b185-4d30-8a0c-174f55472277,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converting VIF {"id": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "address": "fa:16:3e:6e:2b:72", "network": {"id": "9b401830-4c60-4fa8-b66c-769d16076411", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797063952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d10db719f88417e94bf0031ba64a051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e2b0fd-c2", "ovs_interfaceid": "26e2b0fd-c26a-4ef5-a131-89949a669dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG os_vif [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e2b0fd-c2, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b847bec2-0338-4d9f-b6c0-8631415a6484) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:31:57 user nova-compute[75279]: INFO os_vif [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=26e2b0fd-c26a-4ef5-a131-89949a669dc2,network=Network(9b401830-4c60-4fa8-b66c-769d16076411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e2b0fd-c2')
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Deleting instance files /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277_del
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Deletion of /opt/stack/data/nova/instances/e38beaee-b185-4d30-8a0c-174f55472277_del complete
Nov 11 00:31:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.compute.manager [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 11 00:31:57 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Took 0.48 seconds to deallocate network for instance.
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ddfb5e0-283c-481f-8c8c-e1cca94e1fda req-916fef14-b32c-459f-9506-75ea4925b621 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-deleted-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:31:57 user nova-compute[75279]: INFO nova.compute.manager [req-7ddfb5e0-283c-481f-8c8c-e1cca94e1fda req-916fef14-b32c-459f-9506-75ea4925b621 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Neutron deleted interface 26e2b0fd-c26a-4ef5-a131-89949a669dc2; detaching it from the instance and deleting it from the info cache
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.network.neutron [req-7ddfb5e0-283c-481f-8c8c-e1cca94e1fda req-916fef14-b32c-459f-9506-75ea4925b621 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:31:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-7ddfb5e0-283c-481f-8c8c-e1cca94e1fda req-916fef14-b32c-459f-9506-75ea4925b621 service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Detach interface failed, port_id=26e2b0fd-c26a-4ef5-a131-89949a669dc2, reason: Instance e38beaee-b185-4d30-8a0c-174f55472277 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:58 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Deleted allocations for instance e38beaee-b185-4d30-8a0c-174f55472277
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-fd9093eb-7b84-420b-b75c-264f9d8e4069 tempest-VolumesActionsTest-1006138581 tempest-VolumesActionsTest-1006138581-project-member] Lock "e38beaee-b185-4d30-8a0c-174f55472277" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.772s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] Acquiring lock "e38beaee-b185-4d30-8a0c-174f55472277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] Lock "e38beaee-b185-4d30-8a0c-174f55472277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:31:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] No waiting events found dispatching network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:31:58 user nova-compute[75279]: WARNING nova.compute.manager [req-8291cdcf-9ef7-4c81-9fbb-ac5de320816e req-78783b30-0134-4ca3-82fa-75ae5f6f32ba service nova] [instance: e38beaee-b185-4d30-8a0c-174f55472277] Received unexpected event network-vif-plugged-26e2b0fd-c26a-4ef5-a131-89949a669dc2 for instance with vm_state deleted and task_state None.
Nov 11 00:32:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:05 user nova-compute[75279]: INFO nova.compute.manager [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Terminating instance
Nov 11 00:32:05 user nova-compute[75279]: DEBUG nova.compute.manager [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG nova.compute.manager [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG nova.compute.manager [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:32:05 user nova-compute[75279]: DEBUG nova.compute.manager [req-5578557b-af5e-453e-a4c5-b9bd4b96fac3 req-4579ce59-c684-44b7-8cbe-4edb7dc993a3 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-unplugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:32:06 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Instance destroyed successfully.
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.objects.instance [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lazy-loading 'resources' on Instance uuid 67fe80fb-70cc-4242-8e85-0c7adc7052fe {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1101090786',display_name='tempest-ServerActionsTestOtherB-server-1101090786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1101090786',id=37,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF61nb9sp3Wpy17Uv751lY5zqOaAkHSMaOmkRpB/ClRYITdHg1Z1DwtMLFFzNFczFpINb8zA5iKPtuRxLeNFjgqyANReJVbnBJHYlfQW6zIYqis6Xvq6a8u8GqNN1adseg==',key_name='tempest-keypair-1238757532',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfd67c528cc14ba9ad1a6143a942841e',ramdisk_id='',reservation_id='r-msw0z9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-720451106',owner_user_name='tempest-ServerActionsTestOtherB-720451106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b9a76c019d4cc4a63342f70b6209ca',uuid=67fe80fb-70cc-4242-8e85-0c7adc7052fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converting VIF {"id": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "address": "fa:16:3e:70:c6:29", "network": {"id": "e0e21821-f051-4705-b945-b60d19fc38b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007608766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfd67c528cc14ba9ad1a6143a942841e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1433f4d2-b0", "ovs_interfaceid": "1433f4d2-b02a-474d-9d0e-3e73bb3c2273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_vif [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1433f4d2-b0, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89d87f1d-89db-4930-a957-0cab887afb7c) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:06 user nova-compute[75279]: INFO os_vif [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c6:29,bridge_name='br-int',has_traffic_filtering=True,id=1433f4d2-b02a-474d-9d0e-3e73bb3c2273,network=Network(e0e21821-f051-4705-b945-b60d19fc38b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1433f4d2-b0')
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtknhSis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:32:06 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e01beae-70b1-4d9d-b812-3ee5c4ee97b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:32:06 user nova-compute[75279]: No targets found.
Nov 11 00:32:06 user nova-compute[75279]: iSNS:
Nov 11 00:32:06 user nova-compute[75279]: No targets found.
Nov 11 00:32:06 user nova-compute[75279]: STATIC:
Nov 11 00:32:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884
Nov 11 00:32:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1
Nov 11 00:32:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:06 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e
Nov 11 00:32:06 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:06 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:06 user nova-compute[75279]: FIRMWARE:
Nov 11 00:32:06 user nova-compute[75279]: No targets found.
Nov 11 00:32:06 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:32:06 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:32:06 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4a608-3016-43aa-bff6-556a79618fbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8ea0e-a8c1-47b8-8de3-a4e11df97509]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:32:06 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:06 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:32:06 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e (non-flash)
Nov 11 00:32:06 user nova-compute[75279]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:06 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:32:06 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e070a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[936cf315-41f6-4028-a47e-e69e7bc52a6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f18c09-5d08-488d-b5a6-5769e9462f64]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[955dd787-8a15-4ae6-b6f3-0d99c690df50]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d602e2-9495-444f-ba00-babe995d54c0]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4395823-6a86-411b-b1a0-0396f82cd878]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044a222-8572-4ef1-8614-09b01f9612fa]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260]
Nov 11 00:32:06 user nova-compute[75279]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e, portal: 172.16.0.220,3260] successful.
Nov 11 00:32:06 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46d95553-6760-45d7-a227-2eeb6f56b46e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b043bc89-4457-4dde-9f00-ff08f4f3952d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] <== disconnect_volume: return (356ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:32:06 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Deleting instance files /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_del
Nov 11 00:32:06 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Deletion of /opt/stack/data/nova/instances/67fe80fb-70cc-4242-8e85-0c7adc7052fe_del complete
Nov 11 00:32:06 user nova-compute[75279]: INFO nova.compute.manager [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 11 00:32:06 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:32:06 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:32:07 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:07 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Took 0.75 seconds to deallocate network for instance.
Nov 11 00:32:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] Acquiring lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] No waiting events found dispatching network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:32:08 user nova-compute[75279]: WARNING nova.compute.manager [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received unexpected event network-vif-plugged-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 for instance with vm_state active and task_state deleting.
Nov 11 00:32:08 user nova-compute[75279]: DEBUG nova.compute.manager [req-7d8f357f-4021-4dd5-92e6-c789ce42758a req-ae166a08-d7af-4546-976a-a6b60597ba48 service nova] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Received event network-vif-deleted-1433f4d2-b02a-474d-9d0e-3e73bb3c2273 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:08 user nova-compute[75279]: INFO nova.compute.manager [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] [instance: 67fe80fb-70cc-4242-8e85-0c7adc7052fe] Took 0.97 seconds to detach 1 volumes for instance.
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:08 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Deleted allocations for instance 67fe80fb-70cc-4242-8e85-0c7adc7052fe
Nov 11 00:32:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-370fffb7-318a-45d2-94fb-29a1efabf857 tempest-ServerActionsTestOtherB-720451106 tempest-ServerActionsTestOtherB-720451106-project-member] Lock "67fe80fb-70cc-4242-8e85-0c7adc7052fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:32:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing instance network info cache due to event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated VIF entry in instance network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-61907987-97e9-4ece-93f5-3cc3003f8310 req-0fd122ff-269b-4f52-8c1b-9e8eb0d7ada1 service nova] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:32 user nova-compute[75279]: INFO nova.compute.manager [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Shelve offloading
Nov 11 00:32:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:33 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance destroyed successfully.
Nov 11 00:32:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:32:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:32:34 user nova-compute[75279]: WARNING nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state active and task_state shelving.
Nov 11 00:32:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:32:34 user nova-compute[75279]: WARNING nova.compute.manager [req-89f5574d-785e-4555-bc35-f76266e6f87d req-c65b9081-07d0-4c2b-9225-e2a8b5f3cc42 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state active and task_state shelving.
Nov 11 00:32:34 user nova-compute[75279]: DEBUG nova.network.neutron [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:32:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance destroyed successfully.
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.objects.instance [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'resources' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWxXE+nCpB8oQYGZRBRlf9yZs+lUVgFTMdhvQRwsWSeErfVK9m2x3mxCJ994B7EAnaHWiRtNSn5GgDWnJg5CsVkI/nslLvAx/ycnYq9vi6QqFwb4/IMi2YCy2hZWoMK7Q==',key_name='tempest-TestShelveInstance-731418270',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:31:13Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_vif [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe3c169-5e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.compute.manager [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing instance network info cache due to event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e46b7d7d-0a25-4fa3-9ba3-ec35f43b9bc3) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:35 user nova-compute[75279]: INFO os_vif [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e')
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:32:35 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c682e8b-facb-4285-86aa-d4b2ea796605]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:32:35 user nova-compute[75279]: No targets found.
Nov 11 00:32:35 user nova-compute[75279]: iSNS:
Nov 11 00:32:35 user nova-compute[75279]: No targets found.
Nov 11 00:32:35 user nova-compute[75279]: STATIC:
Nov 11 00:32:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884
Nov 11 00:32:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:35 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1
Nov 11 00:32:35 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:35 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:35 user nova-compute[75279]: FIRMWARE:
Nov 11 00:32:35 user nova-compute[75279]: No targets found.
Nov 11 00:32:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:32:35 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:32:35 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f51202-54c4-4a14-8748-67646c100433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[158faf6a-ce8f-4663-a83c-f0ea5f7e60e8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:35 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:32:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:35 user nova-compute[75279]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:32:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71c07bc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d285bf-c93c-44a2-b907-41e287beae0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e72a5d4-d54b-4ca3-ba87-8b191ec58373]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7ae86-00a7-4269-9d76-65f298d18cb6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48e2a56-7bc9-41f8-bb19-df4f4c864cf0]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5169a7-ec01-40b0-a47d-4bc153db26d0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e37b4-2e0d-4a47-88e7-2628a33e8abb]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]
Nov 11 00:32:35 user nova-compute[75279]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.
Nov 11 00:32:35 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ead076-ea43-436d-bd90-41fef4df85bb]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== disconnect_volume: return (319ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:32:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deleting instance files /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69_del
Nov 11 00:32:35 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deletion of /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69_del complete
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated VIF entry in instance network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG nova.network.neutron [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": null, "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:35 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b5059d2a-bad8-4dcd-b19d-71cb1609efbd req-3df6f238-5daf-484a-aa05-14ba34aaca33 service nova] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:32:36 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Deleted allocations for instance e5650742-ab40-4494-b945-25754f12cc69
Nov 11 00:32:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG nova.objects.instance [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'numa_topology' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG nova.objects.base [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Object Instance<e5650742-ab40-4494-b945-25754f12cc69> lazy-loaded attributes: resources,numa_topology {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-dbe5c7d5-5a41-4521-9c84-2278d0bb3eec tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.048s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG nova.compute.manager [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing instance network info cache due to event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG nova.network.neutron [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:32:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated VIF entry in instance network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2b330fc-a370-4931-afd6-9212cea86bd0 req-68f97e6a-e7b4-433e-a37b-ca0a662f1e8d service nova] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.compute.manager [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing instance network info cache due to event network-changed-c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] Acquiring lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] Acquired lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Refreshing network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:38 user nova-compute[75279]: INFO nova.compute.manager [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Detaching volume 52263a53-226c-404d-8c38-7899514bfef1
Nov 11 00:32:38 user nova-compute[75279]: INFO nova.virt.block_device [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Attempting to driver detach volume 52263a53-226c-404d-8c38-7899514bfef1 from mountpoint /dev/vdb
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Attempting to detach device vdb from instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:32:38 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:32:38 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:32:38 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:32:38 user nova-compute[75279]:   <serial>52263a53-226c-404d-8c38-7899514bfef1</serial>
Nov 11 00:32:38 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:32:38 user nova-compute[75279]: </disk>
Nov 11 00:32:38 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:32:38 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully detached device vdb from instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 from the persistent domain config.
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:32:38 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:32:38 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:32:38 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:32:38 user nova-compute[75279]:   <serial>52263a53-226c-404d-8c38-7899514bfef1</serial>
Nov 11 00:32:38 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:32:38 user nova-compute[75279]: </disk>
Nov 11 00:32:38 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updated VIF entry in instance network info cache for port c38edd40-b3cf-4904-aead-2abb110060ad. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG nova.network.neutron [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [{"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:32:38 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a7eaf74e-3513-4230-a315-51910351f220 req-fa6bd98d-628d-4496-b146-fa4151078d50 service nova] Releasing lock "refresh_cache-a6fc9f7a-7754-48ff-b82f-d8da5e463b70" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:32:39 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:32:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:45 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:32:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:32:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:32:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.055866241455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:32:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:32:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:32:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:32:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:32:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:32:59 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 is timed out.
Nov 11 00:32:59 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully detached device vdb from instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 from the live domain config.
Nov 11 00:32:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxynovja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:32:59 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6222c76-34f0-44a0-bb65-8b23bf0c8bff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:32:59 user nova-compute[75279]: No targets found.
Nov 11 00:32:59 user nova-compute[75279]: iSNS:
Nov 11 00:32:59 user nova-compute[75279]: No targets found.
Nov 11 00:32:59 user nova-compute[75279]: STATIC:
Nov 11 00:32:59 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1
Nov 11 00:32:59 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:32:59 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:32:59 user nova-compute[75279]: FIRMWARE:
Nov 11 00:32:59 user nova-compute[75279]: No targets found.
Nov 11 00:32:59 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:32:59 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:32:59 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd6531-46db-4000-9f4f-8143549721dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2cce00-a110-4b62-9dda-723deddea582]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:59 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 (non-flash)
Nov 11 00:32:59 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03e20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[33344234-59b2-493b-86d1-b672e52b40bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ee96f-c282-48b0-af9c-db181deefd21]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b84ca0-21c1-461b-ac43-98243825bb5e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd78e2e-534c-4ca8-8dcd-087e3120a447]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c699c77-683e-450d-a422-370149abe2cd]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a57dcb7-c482-4f80-b0b5-9fe028952119]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260]
Nov 11 00:32:59 user nova-compute[75279]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1, portal: 172.16.0.220,3260] successful.
Nov 11 00:32:59 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52263a53-226c-404d-8c38-7899514bfef1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdaf9be-d7ec-4d35-b351-99170af391c7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] <== disconnect_volume: return (290ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:32:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:33:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:00 user nova-compute[75279]: DEBUG nova.objects.instance [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'flavor' on Instance uuid a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:33:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-50d03a1b-9fa8-47c9-8aa8-0e7ad6d69679 tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:33:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:41 user nova-compute[75279]: INFO nova.compute.manager [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Terminating instance
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.compute.manager [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.compute.manager [req-2f83e989-6de0-4385-88bd-fcbcdaf2a7dc req-8dd79d01-a718-44d2-9cf1-898b39f620c8 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Instance destroyed successfully.
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.objects.instance [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lazy-loading 'resources' on Instance uuid a6fc9f7a-7754-48ff-b82f-d8da5e463b70 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1824298663',display_name='tempest-TestMinimumBasicScenario-server-1824298663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1824298663',id=41,image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3bmLl92yfJun+VJyjnXgPmy6wVKGfp2CTTXgANA552N2DrS8EGPtkc4pBYYdD041bL3zBbuwKLU95vBWD67aIlVFck4CBIIWLSFh46QiTgKzsGGhgOGCKACJkNVJdTNw==',key_name='tempest-TestMinimumBasicScenario-1177857801',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24163a6c612c4b8c87a3715b8a57fc05',ramdisk_id='',reservation_id='r-4qk09nbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8001da3b-443a-432c-9f09-f1eba77322aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-978603383',owner_user_name='tempest-TestMinimumBasicScenario-978603383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:30:54Z,user_data=None,user_id='d7ed7eabc3874d63bbeca2213be1c743',uuid=a6fc9f7a-7754-48ff-b82f-d8da5e463b70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converting VIF {"id": "c38edd40-b3cf-4904-aead-2abb110060ad", "address": "fa:16:3e:bd:b8:12", "network": {"id": "4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1355365154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24163a6c612c4b8c87a3715b8a57fc05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc38edd40-b3", "ovs_interfaceid": "c38edd40-b3cf-4904-aead-2abb110060ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:33:41 user nova-compute[75279]: DEBUG os_vif [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc38edd40-b3, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60de46cb-b314-4e38-9ea0-6e3cc8ad523f) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:42 user nova-compute[75279]: INFO os_vif [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b8:12,bridge_name='br-int',has_traffic_filtering=True,id=c38edd40-b3cf-4904-aead-2abb110060ad,network=Network(4b00ba28-3b91-4a6c-97d7-cd3f2c4925a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc38edd40-b3')
Nov 11 00:33:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Deleting instance files /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70_del
Nov 11 00:33:42 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Deletion of /opt/stack/data/nova/instances/a6fc9f7a-7754-48ff-b82f-d8da5e463b70_del complete
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: INFO nova.compute.manager [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 11 00:33:42 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-6b26f009-4250-4d8b-9957-8a83c3d5c49b req-12e03f51-c26c-40ff-b7b0-11ef08c9d411 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-deleted-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:42 user nova-compute[75279]: INFO nova.compute.manager [req-6b26f009-4250-4d8b-9957-8a83c3d5c49b req-12e03f51-c26c-40ff-b7b0-11ef08c9d411 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Neutron deleted interface c38edd40-b3cf-4904-aead-2abb110060ad; detaching it from the instance and deleting it from the info cache
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.network.neutron [req-6b26f009-4250-4d8b-9957-8a83c3d5c49b req-12e03f51-c26c-40ff-b7b0-11ef08c9d411 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:33:42 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Took 0.68 seconds to deallocate network for instance.
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.compute.manager [req-6b26f009-4250-4d8b-9957-8a83c3d5c49b req-12e03f51-c26c-40ff-b7b0-11ef08c9d411 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Detach interface failed, port_id=c38edd40-b3cf-4904-aead-2abb110060ad, reason: Instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:33:42 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Deleted allocations for instance a6fc9f7a-7754-48ff-b82f-d8da5e463b70
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-99159ea1-ad7b-4580-803a-dd93a023961a tempest-TestMinimumBasicScenario-978603383 tempest-TestMinimumBasicScenario-978603383-project-member] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:43 user nova-compute[75279]: WARNING nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state deleted and task_state None.
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:43 user nova-compute[75279]: WARNING nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state deleted and task_state None.
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:43 user nova-compute[75279]: WARNING nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state deleted and task_state None.
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:43 user nova-compute[75279]: WARNING nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-unplugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state deleted and task_state None.
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Acquiring lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] Lock "a6fc9f7a-7754-48ff-b82f-d8da5e463b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] No waiting events found dispatching network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:33:43 user nova-compute[75279]: WARNING nova.compute.manager [req-facbc2bc-069f-4708-96ec-0a542a4d1102 req-f23fe1a2-97b9-4d93-991e-a37d1a5e9d13 service nova] [instance: a6fc9f7a-7754-48ff-b82f-d8da5e463b70] Received unexpected event network-vif-plugged-c38edd40-b3cf-4904-aead-2abb110060ad for instance with vm_state deleted and task_state None.
Nov 11 00:33:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:33:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:48 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:33:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:33:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:33:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.080810546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:33:53 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:33:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:33:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:33:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:33:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:33:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:33:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:33:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:34:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:34:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:34:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:34:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:24 user nova-compute[75279]: INFO nova.compute.manager [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Unshelving
Nov 11 00:34:25 user nova-compute[75279]: INFO nova.virt.block_device [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Booting with volume ecece15e-77f7-42e1-85e9-cd4a7178e884 at /dev/vda
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac9a667-a231-4921-9e47-a584bbee42cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e68fa-f4ab-4843-a13c-faff087330f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1150c733-a20b-4a1b-8022-fc71dd43e564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed548267-d62a-4060-9984-a8168f117f1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:34:25 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:34:25 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3376ff-dea3-4484-a4ea-f61c2796d5de]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG os_brick.utils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:34:25 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating existing volume attachment record: 688eb90d-4efb-4bbf-b019-0f03a608fc02 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:34:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:46 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:34:46 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:34:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'pci_requests' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'numa_topology' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:34:50 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:34:50 user nova-compute[75279]: INFO nova.compute.claims [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Claim successful on node user
Nov 11 00:34:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:34:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:34:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:51 user nova-compute[75279]: INFO nova.network.neutron [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.compute.manager [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing instance network info cache due to event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:34:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Creating image(s)
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Ensure instance console log exists: /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start _get_guest_xml network_info=[{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5650742-ab40-4494-b945-25754f12cc69', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecece15e-77f7-42e1-85e9-cd4a7178e884', 'serial': 'ecece15e-77f7-42e1-85e9-cd4a7178e884'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '688eb90d-4efb-4bbf-b019-0f03a608fc02', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:34:52 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:34:52 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.objects.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Object Instance<e5650742-ab40-4494-b945-25754f12cc69> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:34:52 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:34:52 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:34:52 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3580f4-d484-4bf5-a2b5-942f56531988]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:34:52 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff408c8-2d59-4028-a8f7-8ec49b22a0d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884] added
Nov 11 00:34:52 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeef0df-848e-49de-ba03-aa13948293f2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9507e84a-ed91-47b4-90ea-ca397ec6ec4d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aowXPCMu {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aowXPCMu" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[face036d-4d2c-4cf1-bf50-71c1ed4df459]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aowXPCMu'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a850238-2727-463f-a0d6-fa6ea290d3e6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a4a1e-0f9c-4287-8750-c46582bcd7ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:34:52 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:34:52 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:34:52 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:34:52 user nova-compute[75279]: 
Nov 11 00:34:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f0150-70f3-4fab-90c1-312fa0dcdbf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]
Nov 11 00:34:53 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.
Nov 11 00:34:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8815f-f52d-47e1-80c3-7779ba233dd4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd5d23-99a6-4830-9471-b1c4c12612e1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:34:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:34:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96577da4-3b54-49e5-8bc6-747362f63205]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated VIF entry in instance network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-f78e1083-cf36-4abf-8e54-ebeb7455b345 req-6724b7bd-1abc-470c-a9c0-7efbba84dd1f service nova] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:34:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26631303936363534', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631303936363534', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-731418270',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:34:25Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'pci_devices' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.objects.base [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Object Instance<e5650742-ab40-4494-b945-25754f12cc69> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75279) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:34:54 user nova-compute[75279]:   <uuid>e5650742-ab40-4494-b945-25754f12cc69</uuid>
Nov 11 00:34:54 user nova-compute[75279]:   <name>instance-0000002b</name>
Nov 11 00:34:54 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:34:54 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:34:54 user nova-compute[75279]:   <metadata>
Nov 11 00:34:54 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:34:54 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:34:54 user nova-compute[75279]:       <nova:name>tempest-TestShelveInstance-server-967064466</nova:name>
Nov 11 00:34:54 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:34:52</nova:creationTime>
Nov 11 00:34:54 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:34:54 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:34:54 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:34:54 user nova-compute[75279]:       <nova:owner>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:user uuid="7e43e7d099fa43da83e809afdbcc5f03">tempest-TestShelveInstance-86237796-project-member</nova:user>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:project uuid="ddf96673db9e40f4ad85ec0b13205621">tempest-TestShelveInstance-86237796</nova:project>
Nov 11 00:34:54 user nova-compute[75279]:       </nova:owner>
Nov 11 00:34:54 user nova-compute[75279]:       <nova:ports>
Nov 11 00:34:54 user nova-compute[75279]:         <nova:port uuid="8fe3c169-5e73-46ca-85e1-f0004230e2c2">
Nov 11 00:34:54 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 11 00:34:54 user nova-compute[75279]:         </nova:port>
Nov 11 00:34:54 user nova-compute[75279]:       </nova:ports>
Nov 11 00:34:54 user nova-compute[75279]:     </nova:instance>
Nov 11 00:34:54 user nova-compute[75279]:   </metadata>
Nov 11 00:34:54 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:34:54 user nova-compute[75279]:     <system>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="serial">e5650742-ab40-4494-b945-25754f12cc69</entry>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="uuid">e5650742-ab40-4494-b945-25754f12cc69</entry>
Nov 11 00:34:54 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:34:54 user nova-compute[75279]:     </system>
Nov 11 00:34:54 user nova-compute[75279]:   </sysinfo>
Nov 11 00:34:54 user nova-compute[75279]:   <os>
Nov 11 00:34:54 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:34:54 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:34:54 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:34:54 user nova-compute[75279]:   </os>
Nov 11 00:34:54 user nova-compute[75279]:   <features>
Nov 11 00:34:54 user nova-compute[75279]:     <acpi/>
Nov 11 00:34:54 user nova-compute[75279]:     <apic/>
Nov 11 00:34:54 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:34:54 user nova-compute[75279]:   </features>
Nov 11 00:34:54 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:34:54 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:34:54 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:34:54 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:34:54 user nova-compute[75279]:   </clock>
Nov 11 00:34:54 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:34:54 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:34:54 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:34:54 user nova-compute[75279]:   </cpu>
Nov 11 00:34:54 user nova-compute[75279]:   <devices>
Nov 11 00:34:54 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:34:54 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:34:54 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:34:54 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:34:54 user nova-compute[75279]:       <serial>ecece15e-77f7-42e1-85e9-cd4a7178e884</serial>
Nov 11 00:34:54 user nova-compute[75279]:     </disk>
Nov 11 00:34:54 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:34:54 user nova-compute[75279]:       <mac address="fa:16:3e:4a:ac:6d"/>
Nov 11 00:34:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:34:54 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:34:54 user nova-compute[75279]:       <target dev="tap8fe3c169-5e"/>
Nov 11 00:34:54 user nova-compute[75279]:     </interface>
Nov 11 00:34:54 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:34:54 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69/console.log" append="off"/>
Nov 11 00:34:54 user nova-compute[75279]:     </serial>
Nov 11 00:34:54 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:34:54 user nova-compute[75279]:     <video>
Nov 11 00:34:54 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:34:54 user nova-compute[75279]:     </video>
Nov 11 00:34:54 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:34:54 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:34:54 user nova-compute[75279]:     </rng>
Nov 11 00:34:54 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:34:54 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:34:54 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:34:54 user nova-compute[75279]:     </memballoon>
Nov 11 00:34:54 user nova-compute[75279]:   </devices>
Nov 11 00:34:54 user nova-compute[75279]: </domain>
Nov 11 00:34:54 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-731418270',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:34:25Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG os_vif [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4d44a30-872e-5972-abf1-877ad3b6ce0e', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe3c169-5e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fe3c169-5e, col_values=(('qos', UUID('14dce75f-d1e3-4604-86a1-b225c29f874d')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fe3c169-5e, col_values=(('external_ids', {'iface-id': '8fe3c169-5e73-46ca-85e1-f0004230e2c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ac:6d', 'vm-uuid': 'e5650742-ab40-4494-b945-25754f12cc69'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:54 user nova-compute[75279]: INFO os_vif [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e')
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] No VIF found with MAC fa:16:3e:4a:ac:6d, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:34:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:34:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:34:58 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.107574462890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance spawned successfully.
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d9002de1-9e35-4b13-abf3-b4c27ac7a991): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8773c8b0-4385-47a2-82da-03ea3f76aa41 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.426s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:34:58 user nova-compute[75279]: DEBUG nova.compute.manager [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:34:58 user nova-compute[75279]: WARNING nova.compute.manager [req-a164d531-1653-4e0f-ad2e-22ad74ceb6f3 req-31785d3f-924d-4585-8890-e82d5c9e2698 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state active and task_state None.
Nov 11 00:34:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:35:00 user nova-compute[75279]: WARNING nova.compute.manager [req-49fdf9ff-2054-43fe-b1d0-1401e9ebf2a7 req-efe816aa-cfa3-45c4-b629-3b6499d4c715 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state active and task_state None.
Nov 11 00:35:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: e5650742-ab40-4494-b945-25754f12cc69] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:35:01 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:35:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:35:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:35:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:35:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Verify base images {{(pid=75279) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75279) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] e5650742-ab40-4494-b945-25754f12cc69 is a valid instance name {{(pid=75279) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a
Nov 11 00:35:15 user nova-compute[75279]: WARNING nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Removable base files: /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65 /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469 /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039 /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2090a8f14d39dc0d5a1b7df94e0742f0b523b65
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ec228d9e10511f5632fbe2b364b7664bc57ce55b
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c9790cc4876a53a65ec6679c25a2f4599c9eade
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d0c9b2a30fc3eed50d663d052a1be3141c6f469
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ced438f2bc79d3803d2dc46acc7272743940d19d
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3818c675dadf1a34802b4ca635759e7444b816d
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea949ab008750eef9d2e2a77148ada5cba6b7039
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a
Nov 11 00:35:15 user nova-compute[75279]: INFO nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ba569a380ca49027e8c7f5d33dc74eebb44152c
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Verification complete {{(pid=75279) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Verify swap images {{(pid=75279) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 11 00:35:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.imagecache [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Verify ephemeral images {{(pid=75279) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 11 00:35:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:35:20 user nova-compute[75279]: INFO nova.compute.claims [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Claim successful on node user
Nov 11 00:35:20 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:20 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:35:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.policy [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8627d0cabc841b1abe1375518db396a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5286e69748d4cda8429be9d4be99fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:35:21 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Creating image(s)
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "/opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "/opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "/opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.287s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.187s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk 1073741824" returned: 0 in 0.053s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:21 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Successfully created port: 60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Cannot resize image /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Ensure instance console log exists: /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Successfully updated port: 60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquired lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-changed-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.compute.manager [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Refreshing instance network info cache due to event network-changed-60f41c18-0166-44e0-9a83-36a996501226. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] Acquiring lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Releasing lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Instance network_info: |[{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] Acquired lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Refreshing network info cache for port 60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Start _get_guest_xml network_info=[{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:35:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:35:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:35:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4828011',id=44,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfFvJzCY+o3CxEcbSWJH3tYhn5S1jEkWgfOVSKXJCUF3V5ItaanXGbCutIs/IkrY7H/KBmknrlgWtOoC3v4dl3/vwdvdec66AR/bZryGbgjedivFAHZOY0Tiy0Mbjcf1Q==',key_name='tempest-keypair-980660177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5286e69748d4cda8429be9d4be99fa1',ramdisk_id='',reservation_id='r-xi0yoa70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8627d0cabc841b1abe1375518db396a',uuid=927de0ef-27d9-46c4-a263-d300d9b84c21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converting VIF {"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.objects.instance [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lazy-loading 'pci_devices' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:35:24 user nova-compute[75279]:   <uuid>927de0ef-27d9-46c4-a263-d300d9b84c21</uuid>
Nov 11 00:35:24 user nova-compute[75279]:   <name>instance-0000002c</name>
Nov 11 00:35:24 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:35:24 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:35:24 user nova-compute[75279]:   <metadata>
Nov 11 00:35:24 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:35:24 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113</nova:name>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:35:23</nova:creationTime>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:35:24 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:35:24 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:owner>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:user uuid="f8627d0cabc841b1abe1375518db396a">tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member</nova:user>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:project uuid="c5286e69748d4cda8429be9d4be99fa1">tempest-TestServerVolumeAttachScenarioOldVersion-1502409011</nova:project>
Nov 11 00:35:24 user nova-compute[75279]:       </nova:owner>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:35:24 user nova-compute[75279]:       <nova:ports>
Nov 11 00:35:24 user nova-compute[75279]:         <nova:port uuid="60f41c18-0166-44e0-9a83-36a996501226">
Nov 11 00:35:24 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:35:24 user nova-compute[75279]:         </nova:port>
Nov 11 00:35:24 user nova-compute[75279]:       </nova:ports>
Nov 11 00:35:24 user nova-compute[75279]:     </nova:instance>
Nov 11 00:35:24 user nova-compute[75279]:   </metadata>
Nov 11 00:35:24 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:35:24 user nova-compute[75279]:     <system>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="serial">927de0ef-27d9-46c4-a263-d300d9b84c21</entry>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="uuid">927de0ef-27d9-46c4-a263-d300d9b84c21</entry>
Nov 11 00:35:24 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:35:24 user nova-compute[75279]:     </system>
Nov 11 00:35:24 user nova-compute[75279]:   </sysinfo>
Nov 11 00:35:24 user nova-compute[75279]:   <os>
Nov 11 00:35:24 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:35:24 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:35:24 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:35:24 user nova-compute[75279]:   </os>
Nov 11 00:35:24 user nova-compute[75279]:   <features>
Nov 11 00:35:24 user nova-compute[75279]:     <acpi/>
Nov 11 00:35:24 user nova-compute[75279]:     <apic/>
Nov 11 00:35:24 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:35:24 user nova-compute[75279]:   </features>
Nov 11 00:35:24 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:35:24 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:35:24 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:35:24 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:35:24 user nova-compute[75279]:   </clock>
Nov 11 00:35:24 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:35:24 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:35:24 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:35:24 user nova-compute[75279]:   </cpu>
Nov 11 00:35:24 user nova-compute[75279]:   <devices>
Nov 11 00:35:24 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:35:24 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:35:24 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk"/>
Nov 11 00:35:24 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:35:24 user nova-compute[75279]:     </disk>
Nov 11 00:35:24 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:35:24 user nova-compute[75279]:       <mac address="fa:16:3e:9b:5e:b7"/>
Nov 11 00:35:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:35:24 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:35:24 user nova-compute[75279]:       <target dev="tap60f41c18-01"/>
Nov 11 00:35:24 user nova-compute[75279]:     </interface>
Nov 11 00:35:24 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:35:24 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/console.log" append="off"/>
Nov 11 00:35:24 user nova-compute[75279]:     </serial>
Nov 11 00:35:24 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:35:24 user nova-compute[75279]:     <video>
Nov 11 00:35:24 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:35:24 user nova-compute[75279]:     </video>
Nov 11 00:35:24 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:35:24 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:35:24 user nova-compute[75279]:     </rng>
Nov 11 00:35:24 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:35:24 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:35:24 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:35:24 user nova-compute[75279]:     </memballoon>
Nov 11 00:35:24 user nova-compute[75279]:   </devices>
Nov 11 00:35:24 user nova-compute[75279]: </domain>
Nov 11 00:35:24 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4828011',id=44,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfFvJzCY+o3CxEcbSWJH3tYhn5S1jEkWgfOVSKXJCUF3V5ItaanXGbCutIs/IkrY7H/KBmknrlgWtOoC3v4dl3/vwdvdec66AR/bZryGbgjedivFAHZOY0Tiy0Mbjcf1Q==',key_name='tempest-keypair-980660177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5286e69748d4cda8429be9d4be99fa1',ramdisk_id='',reservation_id='r-xi0yoa70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8627d0cabc841b1abe1375518db396a',uuid=927de0ef-27d9-46c4-a263-d300d9b84c21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converting VIF {"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG os_vif [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9996a0ba-83b1-5145-8544-64c7cf591b66', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f41c18-01, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60f41c18-01, col_values=(('qos', UUID('3dd1d238-7e72-4365-a8d0-5ef74961ae87')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60f41c18-01, col_values=(('external_ids', {'iface-id': '60f41c18-0166-44e0-9a83-36a996501226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5e:b7', 'vm-uuid': '927de0ef-27d9-46c4-a263-d300d9b84c21'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:24 user nova-compute[75279]: INFO os_vif [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01')
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] No VIF found with MAC fa:16:3e:9b:5e:b7, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updated VIF entry in instance network info cache for port 60f41c18-0166-44e0-9a83-36a996501226. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG nova.network.neutron [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:35:24 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4bb225d2-2cdc-4f0a-91d8-3c6008a0ff6b req-d7272cdd-d378-4eda-bba6-524118cb9e7a service nova] Releasing lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] No waiting events found dispatching network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:35:25 user nova-compute[75279]: WARNING nova.compute.manager [req-2fdedd63-b5ae-48d1-8961-f5b973568c48 req-6692ef60-aeb1-40eb-8164-139a53bd9eff service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received unexpected event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 for instance with vm_state building and task_state spawning.
Nov 11 00:35:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:35:27 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Instance spawned successfully.
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] No waiting events found dispatching network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:35:27 user nova-compute[75279]: WARNING nova.compute.manager [req-9a7bfefc-bbdf-4a75-8c15-d5a727ad5063 req-02ecb050-d946-4e69-a684-9ee8dd34b5f3 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received unexpected event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 for instance with vm_state building and task_state spawning.
Nov 11 00:35:27 user nova-compute[75279]: INFO nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 11 00:35:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:35:27 user nova-compute[75279]: INFO nova.compute.manager [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Took 7.25 seconds to build instance.
Nov 11 00:35:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-329d7f0a-09ab-4710-bcf4-3a967fce5ec5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.359s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:35:29 user nova-compute[75279]: INFO nova.compute.claims [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Claim successful on node user
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:35:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:35:29 user nova-compute[75279]: INFO nova.virt.block_device [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Booting with volume snapshot 32968d13-2748-42ea-9376-fcfb83f6d021 at /dev/vda
Nov 11 00:35:29 user nova-compute[75279]: DEBUG nova.policy [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:35:30 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Successfully created port: b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Successfully updated port: b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-changed-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Refreshing instance network info cache due to event network-changed-b95ead23-8e04-4391-96ed-dc9feb9508a0. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] Acquiring lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Updating instance_info_cache with network_info: [{"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Instance network_info: |[{"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] Acquired lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:35:31 user nova-compute[75279]: DEBUG nova.network.neutron [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Refreshing network info cache for port b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:35:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Updated VIF entry in instance network info cache for port b95ead23-8e04-4391-96ed-dc9feb9508a0. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:35:32 user nova-compute[75279]: DEBUG nova.network.neutron [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Updating instance_info_cache with network_info: [{"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:35:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c08bbcf8-dfe0-4f3e-bd73-cf488d0595e3 req-34c06500-cc4d-4c89-ad0a-62d74d137ef9 service nova] Releasing lock "refresh_cache-caa1ee6e-dc23-480f-b860-16079ac82e74" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:35:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:35:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d647a53-13c8-4578-9a58-c61a2ec45ef9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca9cebc-a0f9-49fa-9a2f-6eb5050c9fb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3e70c-b7c0-4653-af77-9086c82a0fef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a0b5da-30d7-4605-b47b-26d2aaa2d44c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:35:40 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:35:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e51217-6685-4158-9358-df0ae594d928]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG os_brick.utils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:35:40 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Updating existing volume attachment record: b4aa3b9b-4fae-42f6-a4e4-1a611776c951 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:35:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:35:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:35:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:35:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:35:55 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=25.066417694091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e5650742-ab40-4494-b945-25754f12cc69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 927de0ef-27d9-46c4-a263-d300d9b84c21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance caa1ee6e-dc23-480f-b860-16079ac82e74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:35:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:35:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:35:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:35:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:36:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Skipping network cache update for instance because it is Building. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:36:01 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:36:02 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:36:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:36:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:36:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:36:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Creating image(s)
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Ensure instance console log exists: /opt/stack/data/nova/instances/caa1ee6e-dc23-480f-b860-16079ac82e74/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Start _get_guest_xml network_info=[{"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlfoFeEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'caa1ee6e-dc23-480f-b860-16079ac82e74', 'attached_at': '', 'detached_at': '', 'volume_id': '4adc6e60-077c-4995-9339-5598fa676ba8', 'serial': '4adc6e60-077c-4995-9339-5598fa676ba8'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'b4aa3b9b-4fae-42f6-a4e4-1a611776c951', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:36:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:36:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlfoFeEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:36:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:36:04 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:36:04 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[814cc965-1863-4fac-81a1-2ad98faf138a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:36:04 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559acfb-a1dd-457c-915c-700da86d2667]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8] added
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5f9ce-4161-4f34-aa0f-4f289f8c544a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b34db-11ea-4d7a-999e-d067b3671dfc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlfoFeEc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlfoFeEc" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc85f3b-9fd8-454d-8ada-068ede14ca70]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlfoFeEc'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9774f4-7098-4457-baf4-9db3c6f9a291]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[660ffdfd-94f1-4e3e-8fd1-d134abf6da2d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d7722-7f88-4c0e-b445-efb2688fed25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260]
Nov 11 00:36:04 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260] successful.
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3198b6d-af1f-4fa2-b37f-e083dedfc003]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4dbe12-7fc7-42ec-99a9-d41c88fd7114]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:36:04 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ba863-040e-4412-b914-411d3063acb7]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:36:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlfoFeEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23138646161623562', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138646161623562', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1395518858',display_name='tempest-TestVolumeBootPattern-server-1395518858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1395518858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-7tdhnlx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:35:30Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=caa1ee6e-dc23-480f-b860-16079ac82e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid caa1ee6e-dc23-480f-b860-16079ac82e74 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:36:05 user nova-compute[75279]:   <uuid>caa1ee6e-dc23-480f-b860-16079ac82e74</uuid>
Nov 11 00:36:05 user nova-compute[75279]:   <name>instance-0000002d</name>
Nov 11 00:36:05 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:36:05 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:36:05 user nova-compute[75279]:   <metadata>
Nov 11 00:36:05 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:36:05 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:36:05 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-server-1395518858</nova:name>
Nov 11 00:36:05 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:36:04</nova:creationTime>
Nov 11 00:36:05 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:36:05 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:36:05 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:36:05 user nova-compute[75279]:       <nova:owner>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:36:05 user nova-compute[75279]:       </nova:owner>
Nov 11 00:36:05 user nova-compute[75279]:       <nova:ports>
Nov 11 00:36:05 user nova-compute[75279]:         <nova:port uuid="b95ead23-8e04-4391-96ed-dc9feb9508a0">
Nov 11 00:36:05 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:36:05 user nova-compute[75279]:         </nova:port>
Nov 11 00:36:05 user nova-compute[75279]:       </nova:ports>
Nov 11 00:36:05 user nova-compute[75279]:     </nova:instance>
Nov 11 00:36:05 user nova-compute[75279]:   </metadata>
Nov 11 00:36:05 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:36:05 user nova-compute[75279]:     <system>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="serial">caa1ee6e-dc23-480f-b860-16079ac82e74</entry>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="uuid">caa1ee6e-dc23-480f-b860-16079ac82e74</entry>
Nov 11 00:36:05 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:36:05 user nova-compute[75279]:     </system>
Nov 11 00:36:05 user nova-compute[75279]:   </sysinfo>
Nov 11 00:36:05 user nova-compute[75279]:   <os>
Nov 11 00:36:05 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:36:05 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:36:05 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:36:05 user nova-compute[75279]:   </os>
Nov 11 00:36:05 user nova-compute[75279]:   <features>
Nov 11 00:36:05 user nova-compute[75279]:     <acpi/>
Nov 11 00:36:05 user nova-compute[75279]:     <apic/>
Nov 11 00:36:05 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:36:05 user nova-compute[75279]:   </features>
Nov 11 00:36:05 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:36:05 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:36:05 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:36:05 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:36:05 user nova-compute[75279]:   </clock>
Nov 11 00:36:05 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:36:05 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:36:05 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:36:05 user nova-compute[75279]:   </cpu>
Nov 11 00:36:05 user nova-compute[75279]:   <devices>
Nov 11 00:36:05 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:36:05 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:36:05 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:36:05 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:36:05 user nova-compute[75279]:       <serial>4adc6e60-077c-4995-9339-5598fa676ba8</serial>
Nov 11 00:36:05 user nova-compute[75279]:     </disk>
Nov 11 00:36:05 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:36:05 user nova-compute[75279]:       <mac address="fa:16:3e:49:17:73"/>
Nov 11 00:36:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:36:05 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:36:05 user nova-compute[75279]:       <target dev="tapb95ead23-8e"/>
Nov 11 00:36:05 user nova-compute[75279]:     </interface>
Nov 11 00:36:05 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:36:05 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/caa1ee6e-dc23-480f-b860-16079ac82e74/console.log" append="off"/>
Nov 11 00:36:05 user nova-compute[75279]:     </serial>
Nov 11 00:36:05 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:36:05 user nova-compute[75279]:     <video>
Nov 11 00:36:05 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:36:05 user nova-compute[75279]:     </video>
Nov 11 00:36:05 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:36:05 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:36:05 user nova-compute[75279]:     </rng>
Nov 11 00:36:05 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:36:05 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:36:05 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:36:05 user nova-compute[75279]:     </memballoon>
Nov 11 00:36:05 user nova-compute[75279]:   </devices>
Nov 11 00:36:05 user nova-compute[75279]: </domain>
Nov 11 00:36:05 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1395518858',display_name='tempest-TestVolumeBootPattern-server-1395518858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1395518858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-7tdhnlx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:35:30Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=caa1ee6e-dc23-480f-b860-16079ac82e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG os_vif [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12361be9-7670-5613-8411-0a564c0b5db7', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb95ead23-8e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb95ead23-8e, col_values=(('qos', UUID('db56e2dd-7173-4cd2-97ed-d1499538306e')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb95ead23-8e, col_values=(('external_ids', {'iface-id': 'b95ead23-8e04-4391-96ed-dc9feb9508a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:17:73', 'vm-uuid': 'caa1ee6e-dc23-480f-b860-16079ac82e74'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:05 user nova-compute[75279]: INFO os_vif [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e')
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:36:05 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:49:17:73, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:07 user nova-compute[75279]: DEBUG nova.compute.manager [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] No waiting events found dispatching network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:36:07 user nova-compute[75279]: WARNING nova.compute.manager [req-8e1e2963-656b-4cee-91d3-24329b356e28 req-1dd6e26f-dce3-4a36-a2d6-30b158c4f4c0 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received unexpected event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 for instance with vm_state building and task_state spawning.
Nov 11 00:36:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:36:09 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Instance spawned successfully.
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] No waiting events found dispatching network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:36:09 user nova-compute[75279]: WARNING nova.compute.manager [req-950269ec-58c2-409c-ab6c-64ee5baeef67 req-93ec1a33-1f61-4cb3-a967-f762d1738b58 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received unexpected event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 for instance with vm_state building and task_state spawning.
Nov 11 00:36:09 user nova-compute[75279]: INFO nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 11 00:36:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:36:09 user nova-compute[75279]: INFO nova.compute.manager [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Took 40.74 seconds to build instance.
Nov 11 00:36:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4ccb27f1-932b-4202-9631-048bae982df2 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.840s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing instance network info cache due to event network-changed-8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] Acquiring lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] Acquired lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG nova.network.neutron [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Refreshing network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:15 user nova-compute[75279]: INFO nova.compute.manager [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Terminating instance
Nov 11 00:36:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updated VIF entry in instance network info cache for port 8fe3c169-5e73-46ca-85e1-f0004230e2c2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.network.neutron [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [{"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c8384ba0-94b8-4d0d-839a-92d731ab9891 req-ce6bad5d-67ec-4ef9-b87e-4da7c4f9be01 service nova] Releasing lock "refresh_cache-e5650742-ab40-4494-b945-25754f12cc69" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:36:16 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Instance destroyed successfully.
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lazy-loading 'resources' on Instance uuid e5650742-ab40-4494-b945-25754f12cc69 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-11T00:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-967064466',display_name='tempest-TestShelveInstance-server-967064466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-967064466',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWxXE+nCpB8oQYGZRBRlf9yZs+lUVgFTMdhvQRwsWSeErfVK9m2x3mxCJ994B7EAnaHWiRtNSn5GgDWnJg5CsVkI/nslLvAx/ycnYq9vi6QqFwb4/IMi2YCy2hZWoMK7Q==',key_name='tempest-TestShelveInstance-731418270',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddf96673db9e40f4ad85ec0b13205621',ramdisk_id='',reservation_id='r-sd1vrf7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86237796',owner_user_name='tempest-TestShelveInstance-86237796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:34:58Z,user_data=None,user_id='7e43e7d099fa43da83e809afdbcc5f03',uuid=e5650742-ab40-4494-b945-25754f12cc69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converting VIF {"id": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "address": "fa:16:3e:4a:ac:6d", "network": {"id": "15aa2523-64f3-4e95-ae30-3a88c411ae66", "bridge": "br-int", "label": "tempest-TestShelveInstance-574397435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddf96673db9e40f4ad85ec0b13205621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe3c169-5e", "ovs_interfaceid": "8fe3c169-5e73-46ca-85e1-f0004230e2c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_vif [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe3c169-5e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14dce75f-d1e3-4604-86a1-b225c29f874d) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:16 user nova-compute[75279]: INFO os_vif [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ac:6d,bridge_name='br-int',has_traffic_filtering=True,id=8fe3c169-5e73-46ca-85e1-f0004230e2c2,network=Network(15aa2523-64f3-4e95-ae30-3a88c411ae66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe3c169-5e')
Nov 11 00:36:16 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aowXPCMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:36:16 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f72872-f69f-431d-b335-aa71ef23cbc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:36:16 user nova-compute[75279]: No targets found.
Nov 11 00:36:16 user nova-compute[75279]: iSNS:
Nov 11 00:36:16 user nova-compute[75279]: No targets found.
Nov 11 00:36:16 user nova-compute[75279]: STATIC:
Nov 11 00:36:16 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8
Nov 11 00:36:16 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:36:16 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:36:16 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884
Nov 11 00:36:16 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:36:16 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:36:16 user nova-compute[75279]: FIRMWARE:
Nov 11 00:36:16 user nova-compute[75279]: No targets found.
Nov 11 00:36:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:36:16 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:36:16 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[34080518-8c2d-4ada-b921-f3b997a76ee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a21ca-1fc6-42ae-bfae-0717454a7588]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:16 user nova-compute[75279]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:36:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 (non-flash)
Nov 11 00:36:16 user nova-compute[75279]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:36:16 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71f81b7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c7ce39-bb39-4791-a170-03363b6638db]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b198f289-c35c-4b28-a876-90bdc15afd9a]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.033s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0eb7ed-6129-48fb-a5e5-afabfb6870b9]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb600b4-396b-4968-a997-d6af9d37c2f5]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26631303936363534', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6a396d0a', '/dev/disk/by-id/scsi-1SCST_BIO6a396d0a-f10966541f272e0d') {{(pid=86651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23736bf7-7ee3-4c85-94e4-a07c9b187a38]: (4, None) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55369146-7d26-4c57-965a-abb135389c7c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:16 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84152c75-816e-43e1-a351-df4620d2d1a7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260]
Nov 11 00:36:17 user nova-compute[75279]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884, portal: 172.16.0.220,3260] successful.
Nov 11 00:36:17 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecece15e-77f7-42e1-85e9-cd4a7178e884 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6f22d-684d-45e8-8ee4-507011486679]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] <== disconnect_volume: return (339ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:36:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deleting instance files /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69_del
Nov 11 00:36:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deletion of /opt/stack/data/nova/instances/e5650742-ab40-4494-b945-25754f12cc69_del complete
Nov 11 00:36:17 user nova-compute[75279]: INFO nova.compute.manager [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:36:17 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: e5650742-ab40-4494-b945-25754f12cc69] Took 0.72 seconds to deallocate network for instance.
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-711b6ea6-1602-4637-9976-2670c25f9a77 req-ad2628a6-2915-4ac9-b347-bfc70a1d7ff7 service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-deleted-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-unplugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Acquiring lock "e5650742-ab40-4494-b945-25754f12cc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] Lock "e5650742-ab40-4494-b945-25754f12cc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] No waiting events found dispatching network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:36:17 user nova-compute[75279]: WARNING nova.compute.manager [req-e18fbcf6-b4a2-483a-9f32-ebbfca040a62 req-5c6442a1-b7b3-42e1-a0f6-ddbaed3a1c3a service nova] [instance: e5650742-ab40-4494-b945-25754f12cc69] Received unexpected event network-vif-plugged-8fe3c169-5e73-46ca-85e1-f0004230e2c2 for instance with vm_state active and task_state deleting.
Nov 11 00:36:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:36:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:31 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:36 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:40 user nova-compute[75279]: INFO nova.compute.manager [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Took 22.49 seconds to detach 1 volumes for instance.
Nov 11 00:36:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] [instance: e5650742-ab40-4494-b945-25754f12cc69] Deleting volume: ecece15e-77f7-42e1-85e9-cd4a7178e884 {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:36:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:40 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:36:40 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:36:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:40 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Deleted allocations for instance e5650742-ab40-4494-b945-25754f12cc69
Nov 11 00:36:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-3c72e9a9-8f86-4e40-9ed3-95d3de685a98 tempest-TestShelveInstance-86237796 tempest-TestShelveInstance-86237796-project-member] Lock "e5650742-ab40-4494-b945-25754f12cc69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.933s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:41 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:46 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:36:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:36:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:36:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:36:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=25.064044952392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 927de0ef-27d9-46c4-a263-d300d9b84c21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance caa1ee6e-dc23-480f-b860-16079ac82e74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:36:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:36:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:36:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid caa1ee6e-dc23-480f-b860-16079ac82e74 {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:37:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:37:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-changed-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Refreshing instance network info cache due to event network-changed-60f41c18-0166-44e0-9a83-36a996501226. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] Acquiring lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] Acquired lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Refreshing network info cache for port 60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:37:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updated VIF entry in instance network info cache for port 60f41c18-0166-44e0-9a83-36a996501226. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:37:12 user nova-compute[75279]: DEBUG nova.network.neutron [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:37:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0f7bc8d2-d2ce-4a20-83a1-7d0a449902a1 req-0860429d-5e1a-437e-a28d-d1937587223e service nova] Releasing lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:37:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:19 user nova-compute[75279]: INFO nova.compute.manager [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Terminating instance
Nov 11 00:37:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-unplugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] No waiting events found dispatching network-vif-unplugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-ab5e2f05-189b-430b-80c9-f8f733a868f1 req-1b59362f-a1e1-4397-8a24-9acfeb56f434 service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-unplugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Instance destroyed successfully.
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.objects.instance [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid caa1ee6e-dc23-480f-b860-16079ac82e74 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1395518858',display_name='tempest-TestVolumeBootPattern-server-1395518858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1395518858',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-7tdhnlx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:36:10Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=caa1ee6e-dc23-480f-b860-16079ac82e74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "address": "fa:16:3e:49:17:73", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb95ead23-8e", "ovs_interfaceid": "b95ead23-8e04-4391-96ed-dc9feb9508a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_vif [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb95ead23-8e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db56e2dd-7173-4cd2-97ed-d1499538306e) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:37:20 user nova-compute[75279]: INFO os_vif [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:17:73,bridge_name='br-int',has_traffic_filtering=True,id=b95ead23-8e04-4391-96ed-dc9feb9508a0,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb95ead23-8e')
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlfoFeEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:37:20 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14588eb0-6a16-446f-9418-40b0471fa811]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:37:20 user nova-compute[75279]: No targets found.
Nov 11 00:37:20 user nova-compute[75279]: iSNS:
Nov 11 00:37:20 user nova-compute[75279]: No targets found.
Nov 11 00:37:20 user nova-compute[75279]: STATIC:
Nov 11 00:37:20 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8
Nov 11 00:37:20 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:37:20 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:37:20 user nova-compute[75279]: FIRMWARE:
Nov 11 00:37:20 user nova-compute[75279]: No targets found.
Nov 11 00:37:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:37:20 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:37:20 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c0d4f-615a-40d4-bdd0-a5761d793f40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbd196-4223-4a6b-88a5-47edc31dccb6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:37:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 (non-flash)
Nov 11 00:37:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03ed2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037a882-7c21-4e44-bd0d-c36053e75534]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70bcc8-739e-4638-9cd9-d1606ee65e27]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef00e0-3ded-4da9-8fc9-0382499a1689]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23992203-bbc0-4b3a-b3b3-886035758f59]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d60de4b-2ed1-4879-9ad1-b43373468bf6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1bab3e-58ab-4199-9ab2-0d05aa8081cd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260]
Nov 11 00:37:20 user nova-compute[75279]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8, portal: 172.16.0.220,3260] successful.
Nov 11 00:37:20 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4adc6e60-077c-4995-9339-5598fa676ba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06d0ae-f3e7-4406-bc2f-ca3012cfca93]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (329ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:37:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Deleting instance files /opt/stack/data/nova/instances/caa1ee6e-dc23-480f-b860-16079ac82e74_del
Nov 11 00:37:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Deletion of /opt/stack/data/nova/instances/caa1ee6e-dc23-480f-b860-16079ac82e74_del complete
Nov 11 00:37:20 user nova-compute[75279]: INFO nova.compute.manager [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 11 00:37:20 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:37:20 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:37:21 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:37:21 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Took 0.88 seconds to deallocate network for instance.
Nov 11 00:37:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] Acquiring lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] No waiting events found dispatching network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:37:22 user nova-compute[75279]: WARNING nova.compute.manager [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received unexpected event network-vif-plugged-b95ead23-8e04-4391-96ed-dc9feb9508a0 for instance with vm_state active and task_state deleting.
Nov 11 00:37:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-071d7336-3df4-4870-b3ee-4cda1540e846 req-6f9c28cc-d12b-4cbe-b5d2-bd50d7dee1bb service nova] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Received event network-vif-deleted-b95ead23-8e04-4391-96ed-dc9feb9508a0 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:22 user nova-compute[75279]: INFO nova.compute.manager [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Took 1.07 seconds to detach 1 volumes for instance.
Nov 11 00:37:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: caa1ee6e-dc23-480f-b860-16079ac82e74] Deleting volume: 4adc6e60-077c-4995-9339-5598fa676ba8 {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:37:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:23 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance caa1ee6e-dc23-480f-b860-16079ac82e74
Nov 11 00:37:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-b3189964-1a5d-43cf-b849-337a1b8d47dc tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "caa1ee6e-dc23-480f-b860-16079ac82e74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.575s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lazy-loading 'flavor' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:28 user nova-compute[75279]: INFO nova.compute.manager [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Attaching volume 36a2ce30-af2c-4120-b799-83aa69fc218c to /dev/vdb
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.utils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[866b2b86-a2fa-4489-bb70-2d50fbbbfbeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb42af0-f269-4115-8aec-e8eb6865495b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e520da1-0e94-458a-bdff-a224a320575a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c21245a-5b17-4bd2-a624-ab3564e757c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:37:28 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:37:28 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b48fa16-4f71-44ac-80e6-732cb7307d07]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG os_brick.utils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:37:28 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating existing volume attachment record: 6d8f63ed-af85-4ef4-9a68-9695588d8d56 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:37:30 user nova-compute[75279]: INFO nova.compute.claims [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Claim successful on node user
Nov 11 00:37:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:37:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:37:30 user nova-compute[75279]: DEBUG nova.policy [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de973f825da546e7b43be4ee91123fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5008f198ffc44f4bcb6921ebb1f3d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:37:31 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Creating image(s)
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "/opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "/opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "/opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.303s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk 1073741824" returned: 0 in 0.223s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "60f49e6a0d47abd23f2a94ff1a9129b897d1042a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.536s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:31 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Successfully created port: fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.227s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk. size=1073741824 {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.virt.disk.api [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Cannot resize image /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk to a smaller size. {{(pid=75279) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Ensure instance console log exists: /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Successfully updated port: fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.compute.manager [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing instance network info cache due to event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:37:32 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.neutron [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Instance network_info: |[{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Start _get_guest_xml network_info=[{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:37:33 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:55:43Z,direct_url=<?>,disk_format='qcow2',id=94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d47a5ee077ef48929489419ccc7ffff9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-14767685',display_name='tempest-TestStampPattern-server-14767685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-14767685',id=46,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-v5cmx16q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:37:31Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=96b4c31a-8116-489f-87d8-7072a0798d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.objects.instance [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'pci_devices' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:37:33 user nova-compute[75279]:   <uuid>96b4c31a-8116-489f-87d8-7072a0798d25</uuid>
Nov 11 00:37:33 user nova-compute[75279]:   <name>instance-0000002e</name>
Nov 11 00:37:33 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:37:33 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:37:33 user nova-compute[75279]:   <metadata>
Nov 11 00:37:33 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:37:33 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:name>tempest-TestStampPattern-server-14767685</nova:name>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:37:33</nova:creationTime>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:37:33 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:37:33 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:owner>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:user uuid="de973f825da546e7b43be4ee91123fa3">tempest-TestStampPattern-994168132-project-member</nova:user>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:project uuid="e5008f198ffc44f4bcb6921ebb1f3d7c">tempest-TestStampPattern-994168132</nova:project>
Nov 11 00:37:33 user nova-compute[75279]:       </nova:owner>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:root type="image" uuid="94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6"/>
Nov 11 00:37:33 user nova-compute[75279]:       <nova:ports>
Nov 11 00:37:33 user nova-compute[75279]:         <nova:port uuid="fa619269-4e83-4f86-a1af-98b8c50e544a">
Nov 11 00:37:33 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 11 00:37:33 user nova-compute[75279]:         </nova:port>
Nov 11 00:37:33 user nova-compute[75279]:       </nova:ports>
Nov 11 00:37:33 user nova-compute[75279]:     </nova:instance>
Nov 11 00:37:33 user nova-compute[75279]:   </metadata>
Nov 11 00:37:33 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:37:33 user nova-compute[75279]:     <system>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="serial">96b4c31a-8116-489f-87d8-7072a0798d25</entry>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="uuid">96b4c31a-8116-489f-87d8-7072a0798d25</entry>
Nov 11 00:37:33 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:37:33 user nova-compute[75279]:     </system>
Nov 11 00:37:33 user nova-compute[75279]:   </sysinfo>
Nov 11 00:37:33 user nova-compute[75279]:   <os>
Nov 11 00:37:33 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:37:33 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:37:33 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:37:33 user nova-compute[75279]:   </os>
Nov 11 00:37:33 user nova-compute[75279]:   <features>
Nov 11 00:37:33 user nova-compute[75279]:     <acpi/>
Nov 11 00:37:33 user nova-compute[75279]:     <apic/>
Nov 11 00:37:33 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:37:33 user nova-compute[75279]:   </features>
Nov 11 00:37:33 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:37:33 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:37:33 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:37:33 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:37:33 user nova-compute[75279]:   </clock>
Nov 11 00:37:33 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:37:33 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:37:33 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:37:33 user nova-compute[75279]:   </cpu>
Nov 11 00:37:33 user nova-compute[75279]:   <devices>
Nov 11 00:37:33 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:37:33 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:37:33 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk"/>
Nov 11 00:37:33 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:37:33 user nova-compute[75279]:     </disk>
Nov 11 00:37:33 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:37:33 user nova-compute[75279]:       <mac address="fa:16:3e:9a:0a:72"/>
Nov 11 00:37:33 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:37:33 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:37:33 user nova-compute[75279]:       <target dev="tapfa619269-4e"/>
Nov 11 00:37:33 user nova-compute[75279]:     </interface>
Nov 11 00:37:33 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:37:33 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/console.log" append="off"/>
Nov 11 00:37:33 user nova-compute[75279]:     </serial>
Nov 11 00:37:33 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:37:33 user nova-compute[75279]:     <video>
Nov 11 00:37:33 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:37:33 user nova-compute[75279]:     </video>
Nov 11 00:37:33 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:37:33 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:37:33 user nova-compute[75279]:     </rng>
Nov 11 00:37:33 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:37:33 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:37:33 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:37:33 user nova-compute[75279]:     </memballoon>
Nov 11 00:37:33 user nova-compute[75279]:   </devices>
Nov 11 00:37:33 user nova-compute[75279]: </domain>
Nov 11 00:37:33 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-14767685',display_name='tempest-TestStampPattern-server-14767685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-14767685',id=46,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-v5cmx16q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:37:31Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=96b4c31a-8116-489f-87d8-7072a0798d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG os_vif [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bf81981-b5e3-5578-bc2b-832cd6145ebd', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa619269-4e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa619269-4e, col_values=(('qos', UUID('e164b520-0927-4465-87a9-c7eead92f6f9')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa619269-4e, col_values=(('external_ids', {'iface-id': 'fa619269-4e83-4f86-a1af-98b8c50e544a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:0a:72', 'vm-uuid': '96b4c31a-8116-489f-87d8-7072a0798d25'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:33 user nova-compute[75279]: INFO os_vif [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e')
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No VIF found with MAC fa:16:3e:9a:0a:72, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated VIF entry in instance network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG nova.network.neutron [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:37:33 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-84703e40-8d6d-4f3e-af2f-7c2b706b554b req-0990e9ec-b301-4061-bb9b-6981a5699aeb service nova] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:34 user nova-compute[75279]: DEBUG nova.compute.manager [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] No waiting events found dispatching network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:37:34 user nova-compute[75279]: WARNING nova.compute.manager [req-5f97136e-679b-4aac-8e46-c8562da1c20a req-3618bd87-45d4-4ac2-8c6a-ecb91fb4ca7c service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received unexpected event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a for instance with vm_state building and task_state spawning.
Nov 11 00:37:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:37:36 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Instance spawned successfully.
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:36 user nova-compute[75279]: DEBUG nova.compute.manager [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] No waiting events found dispatching network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:37:36 user nova-compute[75279]: WARNING nova.compute.manager [req-0a0f67d2-5c19-42e0-b881-80c569536299 req-a2686d26-e543-42cc-b3e1-7d547ffe4f0d service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received unexpected event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a for instance with vm_state building and task_state spawning.
Nov 11 00:37:37 user nova-compute[75279]: INFO nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 11 00:37:37 user nova-compute[75279]: DEBUG nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:37:37 user nova-compute[75279]: INFO nova.compute.manager [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Took 6.76 seconds to build instance.
Nov 11 00:37:37 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-a24081b8-3b63-4bd2-9ba9-3c82d8c89139 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:47 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:47 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:37:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:37:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:37:56 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=25.033283233642578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 927de0ef-27d9-46c4-a263-d300d9b84c21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:37:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:37:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:37:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:37:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:38:04 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:38:05 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [{"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:38:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-927de0ef-27d9-46c4-a263-d300d9b84c21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:38:05 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:38:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gudQImAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:38:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:38:13 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:38:13 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b56b2-1d0f-4c47-a88f-c50225143d0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:38:13 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc382a76-5b6b-4f3d-a469-72f41af82730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c] added
Nov 11 00:38:13 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c461874-0dd6-4788-8ea0-1cef4af33075]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2223511f-2999-4bfd-81a2-316cc592ef41]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gudQImAS {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gudQImAS" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8a0a4-1b14-48ca-90c8-6b863fa07f11]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gudQImAS'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794d1e4-090b-4e8e-a493-0494a09d9a03]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64bda92-f024-4880-8a95-a9126cd447ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:38:14 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:38:14 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:38:14 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:38:14 user nova-compute[75279]: 
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5a8b3-a061-4641-ae3b-7d7dab76beff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260]
Nov 11 00:38:14 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260] successful.
Nov 11 00:38:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e90a7-c018-4a01-bddd-c956a010a42f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff27962-7bc9-40ff-b837-1f726c7348e4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)
Nov 11 00:38:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)
Nov 11 00:38:14 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84bb518-c1b9-4724-a2da-19bb0b63b191]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:38:14 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gudQImAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26139313062613233', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139313062613233', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.objects.instance [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lazy-loading 'flavor' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:38:15 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:38:15 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:38:15 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:38:15 user nova-compute[75279]:   <serial>36a2ce30-af2c-4120-b799-83aa69fc218c</serial>
Nov 11 00:38:15 user nova-compute[75279]: </disk>
Nov 11 00:38:15 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] No VIF found with MAC fa:16:3e:9b:5e:b7, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:38:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-f33a3d9d-48d1-4169-974c-4ef802694895 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.507s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:38:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:38:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:38:17 user nova-compute[75279]: INFO nova.compute.manager [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Detaching volume 36a2ce30-af2c-4120-b799-83aa69fc218c
Nov 11 00:38:17 user nova-compute[75279]: INFO nova.virt.block_device [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Attempting to driver detach volume 36a2ce30-af2c-4120-b799-83aa69fc218c from mountpoint /dev/vdb
Nov 11 00:38:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Attempting to detach device vdb from instance 927de0ef-27d9-46c4-a263-d300d9b84c21 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:38:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:38:17 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:38:17 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:38:17 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:38:17 user nova-compute[75279]:   <serial>36a2ce30-af2c-4120-b799-83aa69fc218c</serial>
Nov 11 00:38:17 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:38:17 user nova-compute[75279]: </disk>
Nov 11 00:38:17 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:38:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Successfully detached device vdb from instance 927de0ef-27d9-46c4-a263-d300d9b84c21 from the persistent domain config.
Nov 11 00:38:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 927de0ef-27d9-46c4-a263-d300d9b84c21 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:38:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:38:17 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:38:17 user nova-compute[75279]:   <source dev="/dev/sdb"/>
Nov 11 00:38:17 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:38:17 user nova-compute[75279]:   <serial>36a2ce30-af2c-4120-b799-83aa69fc218c</serial>
Nov 11 00:38:17 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:38:17 user nova-compute[75279]: </disk>
Nov 11 00:38:17 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:38:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:18 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:38:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:38 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 927de0ef-27d9-46c4-a263-d300d9b84c21 is timed out.
Nov 11 00:38:38 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Successfully detached device vdb from instance 927de0ef-27d9-46c4-a263-d300d9b84c21 from the live domain config.
Nov 11 00:38:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gudQImAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:38:38 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76ac32c-d5c2-4845-b67c-acde3ea48dd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:38:38 user nova-compute[75279]: No targets found.
Nov 11 00:38:38 user nova-compute[75279]: iSNS:
Nov 11 00:38:38 user nova-compute[75279]: No targets found.
Nov 11 00:38:38 user nova-compute[75279]: STATIC:
Nov 11 00:38:38 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c
Nov 11 00:38:38 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:38:38 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:38:38 user nova-compute[75279]: FIRMWARE:
Nov 11 00:38:38 user nova-compute[75279]: No targets found.
Nov 11 00:38:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:38:38 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:38:38 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0b4be-9b8f-40b2-adb5-661fec48ceb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11275e-e65d-4fcd-bb8e-fdbbbab088f8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)
Nov 11 00:38:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c (non-flash)
Nov 11 00:38:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03d4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62378e-dbc6-423a-b67d-1b04a9c92a92]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04bbf42-79f0-403f-a742-0daf84d91032]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c0bb9c-8f59-4678-b3de-dc3ae91fe418]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee904d9-4fdc-4d48-a535-4313964f29bf]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1e0d0a-694b-484b-87fe-108fd9d3c3f0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d22ee-55a6-40ec-89f7-2431f9c62d3e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260]
Nov 11 00:38:38 user nova-compute[75279]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c, portal: 172.16.0.220,3260] successful.
Nov 11 00:38:38 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a2ce30-af2c-4120-b799-83aa69fc218c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7652f9-8b84-4766-a2ca-55977cd3ab1c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] <== disconnect_volume: return (289ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:38:38 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:38:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:49 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:38:50 user nova-compute[75279]: DEBUG nova.objects.instance [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lazy-loading 'flavor' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:38:50 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-e60add25-6488-4e07-9c98-1eef618b50f5 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.407s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:38:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:38:57 user nova-compute[75279]: INFO nova.compute.claims [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Claim successful on node user
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:57 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:38:57 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.02163314819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:38:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.155s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:38:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 927de0ef-27d9-46c4-a263-d300d9b84c21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.policy [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:38:58 user nova-compute[75279]: INFO nova.virt.block_device [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Booting with volume 54f3b873-0b02-4b94-9a5f-14bcdd7398af at /dev/vda
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.utils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4f722-d29a-4bd8-bb73-f8a78665dec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9fff53-f600-4e47-b3e6-d2baeddba698]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e31349-c930-4864-b6e9-1bf8d8d0e7e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b72119-8a92-4452-a033-2f30d277d369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:38:58 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:38:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5872b6db-1697-4eca-b47e-a01edf718750]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG os_brick.utils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating existing volume attachment record: e0916e16-ff0f-4573-b868-574cf224c28b {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:38:58 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Successfully created port: db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Successfully updated port: db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-changed-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Refreshing instance network info cache due to event network-changed-db4c0e08-718a-4116-a315-a704dcef6896. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] Acquiring lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.network.neutron [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Instance network_info: |[{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] Acquired lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:38:59 user nova-compute[75279]: DEBUG nova.network.neutron [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Refreshing network info cache for port db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:39:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updated VIF entry in instance network info cache for port db4c0e08-718a-4116-a315-a704dcef6896. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:39:00 user nova-compute[75279]: DEBUG nova.network.neutron [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:39:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b2274ba7-ac89-4674-a542-72cd68bf39a1 req-573b7454-e695-4fd3-9bd9-0f4486dfc950 service nova] Releasing lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:39:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:39:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:39:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:19 user nova-compute[75279]: INFO nova.compute.manager [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Terminating instance
Nov 11 00:39:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-unplugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] No waiting events found dispatching network-vif-unplugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.compute.manager [req-8ff0ec5d-ec45-4a7e-857e-885a1985b7dd req-7b102770-9696-4050-a463-0fdc35b56ee2 service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-unplugged-60f41c18-0166-44e0-9a83-36a996501226 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:39:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Instance destroyed successfully.
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.objects.instance [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lazy-loading 'resources' on Instance uuid 927de0ef-27d9-46c4-a263-d300d9b84c21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-482801113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4828011',id=44,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfFvJzCY+o3CxEcbSWJH3tYhn5S1jEkWgfOVSKXJCUF3V5ItaanXGbCutIs/IkrY7H/KBmknrlgWtOoC3v4dl3/vwdvdec66AR/bZryGbgjedivFAHZOY0Tiy0Mbjcf1Q==',key_name='tempest-keypair-980660177',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5286e69748d4cda8429be9d4be99fa1',ramdisk_id='',reservation_id='r-xi0yoa70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8627d0cabc841b1abe1375518db396a',uuid=927de0ef-27d9-46c4-a263-d300d9b84c21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converting VIF {"id": "60f41c18-0166-44e0-9a83-36a996501226", "address": "fa:16:3e:9b:5e:b7", "network": {"id": "ea373744-9685-43bb-afda-3baddb65b89c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-669994912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5286e69748d4cda8429be9d4be99fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f41c18-01", "ovs_interfaceid": "60f41c18-0166-44e0-9a83-36a996501226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG os_vif [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f41c18-01, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dd1d238-7e72-4365-a8d0-5ef74961ae87) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:20 user nova-compute[75279]: INFO os_vif [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=60f41c18-0166-44e0-9a83-36a996501226,network=Network(ea373744-9685-43bb-afda-3baddb65b89c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f41c18-01')
Nov 11 00:39:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Deleting instance files /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21_del
Nov 11 00:39:20 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Deletion of /opt/stack/data/nova/instances/927de0ef-27d9-46c4-a263-d300d9b84c21_del complete
Nov 11 00:39:20 user nova-compute[75279]: INFO nova.compute.manager [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 11 00:39:20 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:39:20 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:39:21 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Took 0.72 seconds to deallocate network for instance.
Nov 11 00:39:21 user nova-compute[75279]: DEBUG nova.compute.manager [req-58cb1301-db87-4dea-adff-d960cc0d1d40 req-6338fff3-184b-4c5e-9123-2cbd27aeacba service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-deleted-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:39:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:21 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Deleted allocations for instance 927de0ef-27d9-46c4-a263-d300d9b84c21
Nov 11 00:39:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-42d96983-0cbb-4dbb-ad54-6f9f1f5190a3 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011 tempest-TestServerVolumeAttachScenarioOldVersion-1502409011-project-member] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] Acquiring lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] Lock "927de0ef-27d9-46c4-a263-d300d9b84c21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] No waiting events found dispatching network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:39:22 user nova-compute[75279]: WARNING nova.compute.manager [req-e9079523-60b6-47af-bb4e-775f8a7f86dd req-ea47ab3b-21ac-4eda-bf7d-51152d3c9cfe service nova] [instance: 927de0ef-27d9-46c4-a263-d300d9b84c21] Received unexpected event network-vif-plugged-60f41c18-0166-44e0-9a83-36a996501226 for instance with vm_state deleted and task_state None.
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:39:22 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Creating image(s)
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Ensure instance console log exists: /opt/stack/data/nova/instances/3ecb50a7-ec0f-4f96-8c45-ca8d45d98869/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Start _get_guest_xml network_info=[{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJurDNTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ecb50a7-ec0f-4f96-8c45-ca8d45d98869', 'attached_at': '', 'detached_at': '', 'volume_id': '54f3b873-0b02-4b94-9a5f-14bcdd7398af', 'serial': '54f3b873-0b02-4b94-9a5f-14bcdd7398af'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'e0916e16-ff0f-4573-b868-574cf224c28b', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:39:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:39:22 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJurDNTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:39:22 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:39:22 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:39:22 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb489c-47bd-45e1-a693-06707ec6dfbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:39:22 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78c7c6-7f67-40d1-8250-cf5f4ef52f72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af] added
Nov 11 00:39:22 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c0b3ba-6799-4860-9a74-7f0fa8a12d8f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[478917f8-e8c9-477c-b4e7-f9ab3d4ac15b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.compute.manager [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing instance network info cache due to event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.network.neutron [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJurDNTy {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJurDNTy" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2244ae8-8ae6-40fb-8fa8-da00850e6e26]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJurDNTy'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc145c4-85a2-472f-8dbc-2a3fa233cd40]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d7c407-4267-4ca7-80dc-fba87054fd96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:39:22 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:39:22 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:39:22 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:39:22 user nova-compute[75279]: 
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dcb54c-4f6b-4b5c-866a-98fc99b73072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260]
Nov 11 00:39:22 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260] successful.
Nov 11 00:39:22 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d6daa6-bb0c-4a0e-8916-7487e9142fc2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fbe34-2182-49bc-8ded-0343499e3f3f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:22 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:22 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f27098f-7d8d-4f20-b85b-e6cc23c64576]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJurDNTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG nova.objects.instance [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:39:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated VIF entry in instance network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.neutron [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:23 user nova-compute[75279]: INFO nova.compute.manager [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Attaching volume d4d3cf29-3365-4831-8437-579e52cff706 to /dev/vdb
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d9b20be3-e560-485d-82ea-49280755419e req-bf722fda-49d8-4d44-8549-2e07d7e235fe service nova] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.utils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e729527c-0f3c-4dd5-975d-5c414b5089f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee315e5b-9174-42cc-8673-1041a9102f3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fde282-7153-4e00-bbfc-90ab0a6491ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddad8dc3-6c74-4890-a8a7-0f7f484836ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:39:23 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:39:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c8840-ed68-4126-8866-156db1d01837]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.utils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating existing volume attachment record: 6bec8308-9de3-45df-9048-c72168b89264 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23466313562646335', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466313562646335', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545286547',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfxCr1ep9MYvtkzvzvxRGJ04i4FfNliSJ8+9GvHNSRxFt700ts3j2Zew3vRCQyJEoplPXZiWAke1NgVnflntXnydJXI/S31C7Im1ZLMMhD8G+HU1R7Ii0bWNZ5jYD7IeQ==',key_name='tempest-keypair-63910120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-3umm4qmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=3ecb50a7-ec0f-4f96-8c45-ca8d45d98869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.objects.instance [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:39:23 user nova-compute[75279]:   <uuid>3ecb50a7-ec0f-4f96-8c45-ca8d45d98869</uuid>
Nov 11 00:39:23 user nova-compute[75279]:   <name>instance-0000002f</name>
Nov 11 00:39:23 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:39:23 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:39:23 user nova-compute[75279]:   <metadata>
Nov 11 00:39:23 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:39:23 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:39:23 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1545286547</nova:name>
Nov 11 00:39:23 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:39:22</nova:creationTime>
Nov 11 00:39:23 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:39:23 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:39:23 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:39:23 user nova-compute[75279]:       <nova:owner>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:39:23 user nova-compute[75279]:       </nova:owner>
Nov 11 00:39:23 user nova-compute[75279]:       <nova:ports>
Nov 11 00:39:23 user nova-compute[75279]:         <nova:port uuid="db4c0e08-718a-4116-a315-a704dcef6896">
Nov 11 00:39:23 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:39:23 user nova-compute[75279]:         </nova:port>
Nov 11 00:39:23 user nova-compute[75279]:       </nova:ports>
Nov 11 00:39:23 user nova-compute[75279]:     </nova:instance>
Nov 11 00:39:23 user nova-compute[75279]:   </metadata>
Nov 11 00:39:23 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:39:23 user nova-compute[75279]:     <system>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="serial">3ecb50a7-ec0f-4f96-8c45-ca8d45d98869</entry>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="uuid">3ecb50a7-ec0f-4f96-8c45-ca8d45d98869</entry>
Nov 11 00:39:23 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:39:23 user nova-compute[75279]:     </system>
Nov 11 00:39:23 user nova-compute[75279]:   </sysinfo>
Nov 11 00:39:23 user nova-compute[75279]:   <os>
Nov 11 00:39:23 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:39:23 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:39:23 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:39:23 user nova-compute[75279]:   </os>
Nov 11 00:39:23 user nova-compute[75279]:   <features>
Nov 11 00:39:23 user nova-compute[75279]:     <acpi/>
Nov 11 00:39:23 user nova-compute[75279]:     <apic/>
Nov 11 00:39:23 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:39:23 user nova-compute[75279]:   </features>
Nov 11 00:39:23 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:39:23 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:39:23 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:39:23 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:39:23 user nova-compute[75279]:   </clock>
Nov 11 00:39:23 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:39:23 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:39:23 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:39:23 user nova-compute[75279]:   </cpu>
Nov 11 00:39:23 user nova-compute[75279]:   <devices>
Nov 11 00:39:23 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:39:23 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:39:23 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:39:23 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:39:23 user nova-compute[75279]:       <serial>54f3b873-0b02-4b94-9a5f-14bcdd7398af</serial>
Nov 11 00:39:23 user nova-compute[75279]:     </disk>
Nov 11 00:39:23 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:39:23 user nova-compute[75279]:       <mac address="fa:16:3e:ec:2b:15"/>
Nov 11 00:39:23 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:39:23 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:39:23 user nova-compute[75279]:       <target dev="tapdb4c0e08-71"/>
Nov 11 00:39:23 user nova-compute[75279]:     </interface>
Nov 11 00:39:23 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:39:23 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/3ecb50a7-ec0f-4f96-8c45-ca8d45d98869/console.log" append="off"/>
Nov 11 00:39:23 user nova-compute[75279]:     </serial>
Nov 11 00:39:23 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:39:23 user nova-compute[75279]:     <video>
Nov 11 00:39:23 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:39:23 user nova-compute[75279]:     </video>
Nov 11 00:39:23 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:39:23 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:39:23 user nova-compute[75279]:     </rng>
Nov 11 00:39:23 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:39:23 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:39:23 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:39:23 user nova-compute[75279]:     </memballoon>
Nov 11 00:39:23 user nova-compute[75279]:   </devices>
Nov 11 00:39:23 user nova-compute[75279]: </domain>
Nov 11 00:39:23 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545286547',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfxCr1ep9MYvtkzvzvxRGJ04i4FfNliSJ8+9GvHNSRxFt700ts3j2Zew3vRCQyJEoplPXZiWAke1NgVnflntXnydJXI/S31C7Im1ZLMMhD8G+HU1R7Ii0bWNZ5jYD7IeQ==',key_name='tempest-keypair-63910120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-3umm4qmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=3ecb50a7-ec0f-4f96-8c45-ca8d45d98869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG os_vif [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e57db8e4-f302-5177-8e84-2554e470b40a', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb4c0e08-71, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb4c0e08-71, col_values=(('qos', UUID('91386ca0-46ce-443e-87f1-cceee46f5d9b')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb4c0e08-71, col_values=(('external_ids', {'iface-id': 'db4c0e08-718a-4116-a315-a704dcef6896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:2b:15', 'vm-uuid': '3ecb50a7-ec0f-4f96-8c45-ca8d45d98869'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:23 user nova-compute[75279]: INFO os_vif [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71')
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:39:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:ec:2b:15, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG nova.compute.manager [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] No waiting events found dispatching network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:39:25 user nova-compute[75279]: WARNING nova.compute.manager [req-abf13a4d-973f-4df5-b014-a70410c56fd2 req-c0347e70-8ebf-4e82-a14e-65e59c67a468 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received unexpected event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 for instance with vm_state building and task_state spawning.
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:39:27 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Instance spawned successfully.
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:39:27 user nova-compute[75279]: INFO nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:27 user nova-compute[75279]: DEBUG nova.compute.manager [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] No waiting events found dispatching network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:39:27 user nova-compute[75279]: WARNING nova.compute.manager [req-36a2575f-5674-4346-a974-387bd513bd11 req-efff5daf-47c4-4cff-b1e1-3f9ee389f0dc service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received unexpected event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 for instance with vm_state building and task_state spawning.
Nov 11 00:39:27 user nova-compute[75279]: INFO nova.compute.manager [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Took 30.37 seconds to build instance.
Nov 11 00:39:27 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-cb515b5f-c0c0-4d33-a2e1-32c0d0fcc82c tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.490s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opLjADGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:39:46 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:39:46 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:39:46 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad3e02-7a2f-4e6a-866b-e4611645514a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:39:46 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e76b6-6a11-42d0-bcd4-d22a19463699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706] added
Nov 11 00:39:46 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:46 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d02d5-0c8b-4932-8420-f573f740edd7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[632df474-d379-4d58-aba9-153f404cebc4]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opLjADGI {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opLjADGI" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b0d1f-d05c-4702-9155-7994c9e663ae]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opLjADGI'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c773b-58ed-41e1-a639-681ca38806db]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8300b4-21f9-4faa-bbe1-cf32e7db740f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090c089-c9cb-4ba0-a791-9f704348b4f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260]
Nov 11 00:39:47 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260] successful.
Nov 11 00:39:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f57f56f-ddea-4d51-8ad0-99d2c35aec12]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a48a631-5047-49d5-929e-16c38027abd5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:47 user nova-compute[75279]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)
Nov 11 00:39:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:39:47 user nova-compute[75279]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)
Nov 11 00:39:47 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a4253-dd4e-4e69-b9c1-74c3d3bf16a6]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:39:47 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opLjADGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23661316561356433', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661316561356433', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.objects.instance [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:39:48 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:39:48 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:39:48 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:39:48 user nova-compute[75279]:   <serial>d4d3cf29-3365-4831-8437-579e52cff706</serial>
Nov 11 00:39:48 user nova-compute[75279]: </disk>
Nov 11 00:39:48 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No VIF found with MAC fa:16:3e:9a:0a:72, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-7aa9d6e0-4dc5-42dd-acf6-28caf3ffa3ef tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.774s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:50 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:50 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:39:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:51 user nova-compute[75279]: INFO nova.compute.manager [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Detaching volume d4d3cf29-3365-4831-8437-579e52cff706
Nov 11 00:39:51 user nova-compute[75279]: INFO nova.virt.block_device [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Attempting to driver detach volume d4d3cf29-3365-4831-8437-579e52cff706 from mountpoint /dev/vdb
Nov 11 00:39:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Attempting to detach device vdb from instance 96b4c31a-8116-489f-87d8-7072a0798d25 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:39:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:39:51 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:39:51 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:39:51 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:39:51 user nova-compute[75279]:   <serial>d4d3cf29-3365-4831-8437-579e52cff706</serial>
Nov 11 00:39:51 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:39:51 user nova-compute[75279]: </disk>
Nov 11 00:39:51 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:39:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully detached device vdb from instance 96b4c31a-8116-489f-87d8-7072a0798d25 from the persistent domain config.
Nov 11 00:39:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96b4c31a-8116-489f-87d8-7072a0798d25 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:39:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:39:51 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:39:51 user nova-compute[75279]:   <source dev="/dev/sdc"/>
Nov 11 00:39:51 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:39:51 user nova-compute[75279]:   <serial>d4d3cf29-3365-4831-8437-579e52cff706</serial>
Nov 11 00:39:51 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:39:51 user nova-compute[75279]: </disk>
Nov 11 00:39:51 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:39:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:39:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:39:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:39:59 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:39:59 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=25.04708480834961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:39:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:40:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:40:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:12 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96b4c31a-8116-489f-87d8-7072a0798d25 is timed out.
Nov 11 00:40:12 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully detached device vdb from instance 96b4c31a-8116-489f-87d8-7072a0798d25 from the live domain config.
Nov 11 00:40:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opLjADGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:40:12 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d614ca4-88c5-48b2-bbe9-5b6cd865ce30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:40:12 user nova-compute[75279]: No targets found.
Nov 11 00:40:12 user nova-compute[75279]: iSNS:
Nov 11 00:40:12 user nova-compute[75279]: No targets found.
Nov 11 00:40:12 user nova-compute[75279]: STATIC:
Nov 11 00:40:12 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af
Nov 11 00:40:12 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:40:12 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:40:12 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706
Nov 11 00:40:12 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:40:12 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:40:12 user nova-compute[75279]: FIRMWARE:
Nov 11 00:40:12 user nova-compute[75279]: No targets found.
Nov 11 00:40:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:40:12 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:40:12 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cba96-2456-4534-93f2-19bda65f7510]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a81cb6-98cf-4b63-8eb6-9fa5018f22f3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:40:12 user nova-compute[75279]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)
Nov 11 00:40:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:40:12 user nova-compute[75279]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 (non-flash)
Nov 11 00:40:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e02229e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f568cd6-cba0-469b-8b80-ebde86b7d234]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf622a2-d4c6-4a00-8180-c768ef1c40ee]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5b333-8583-4a4e-8848-19743a6fb2d1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0babf978-ef9f-430f-8a0a-5e9b8dbf75e1]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.058s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[19254b08-06b7-4780-9605-d8cbc104a1a2]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ef02f-790a-4155-8ab6-3fce2993f640]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260]
Nov 11 00:40:12 user nova-compute[75279]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706, portal: 172.16.0.220,3260] successful.
Nov 11 00:40:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d3cf29-3365-4831-8437-579e52cff706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8754b9ec-e9ab-4358-b0dd-6465af019c00]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== disconnect_volume: return (336ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:40:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:40:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:40:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c0f84441-c31d-4649-8756-3cdd09374a0a tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:40:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-changed-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Refreshing instance network info cache due to event network-changed-db4c0e08-718a-4116-a315-a704dcef6896. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] Acquiring lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] Acquired lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Refreshing network info cache for port db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updated VIF entry in instance network info cache for port db4c0e08-718a-4116-a315-a704dcef6896. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c1a68907-eeb2-48f5-a9ff-d473b46614dc req-021faacb-0bf9-40e9-b78b-9660e9fc67a6 service nova] Releasing lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:40:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:51 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:40:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:40:54 user nova-compute[75279]: INFO nova.compute.manager [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] instance snapshotting
Nov 11 00:40:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Beginning live snapshot process
Nov 11 00:40:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json -f qcow2 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477.delta 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60f49e6a0d47abd23f2a94ff1a9129b897d1042a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477.delta 1073741824" returned: 0 in 0.054s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 11 00:40:55 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:40:56 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75279) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 11 00:40:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 11 00:40:56 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:40:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477.delta /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:56 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477.delta /opt/stack/data/nova/instances/snapshots/tmpwmqx5os_/67d457cba8b14ff29d1eafa1c827f477" returned: 0 in 0.560s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:56 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Snapshot extracted, beginning image upload
Nov 11 00:40:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:59 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Snapshot image upload complete
Nov 11 00:40:59 user nova-compute[75279]: INFO nova.compute.manager [None req-5070591c-b5e7-465e-90b1-67c0b19f24a3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Took 5.36 seconds to snapshot the instance on the hypervisor.
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:40:59 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:00 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:00 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.94720458984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:41:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:02 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:41:02 user nova-compute[75279]: INFO nova.compute.claims [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Claim successful on node user
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:41:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.policy [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de973f825da546e7b43be4ee91123fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5008f198ffc44f4bcb6921ebb1f3d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:41:03 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Creating image(s)
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "/opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "/opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "4531965546f81d9d6714ceecb192a5528ee53c4e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "4531965546f81d9d6714ceecb192a5528ee53c4e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.part --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG nova.virt.images [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] 3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd was qcow2, converting to raw {{(pid=75279) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG nova.privsep.utils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75279) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.part /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.converted {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.part /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.converted" returned: 0 in 0.290s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.converted --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "4531965546f81d9d6714ceecb192a5528ee53c4e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json" returned: 0 in 0.208s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "4531965546f81d9d6714ceecb192a5528ee53c4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "4531965546f81d9d6714ceecb192a5528ee53c4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:05 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json" returned: 0 in 0.184s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e,backing_fmt=raw /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk 1073741824 {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Successfully created port: ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e,backing_fmt=raw /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk 1073741824" returned: 0 in 0.064s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "4531965546f81d9d6714ceecb192a5528ee53c4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4531965546f81d9d6714ceecb192a5528ee53c4e --force-share --output=json" returned: 0 in 0.198s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Created local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Ensure instance console log exists: /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Successfully updated port: ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:41:06 user nova-compute[75279]: INFO nova.compute.claims [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Claim successful on node user
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquired lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing instance network info cache due to event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:41:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] Acquiring lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:41:07 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Releasing lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Instance network_info: |[{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] Acquired lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Start _get_guest_xml network_info=[{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='83077e468d37bf385b0a4effe58c3d52',container_format='bare',created_at=2023-11-11T00:40:54Z,direct_url=<?>,disk_format='qcow2',id=3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1057405191',owner='e5008f198ffc44f4bcb6921ebb1f3d7c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:41:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:41:07 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:07 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='83077e468d37bf385b0a4effe58c3d52',container_format='bare',created_at=2023-11-11T00:40:54Z,direct_url=<?>,disk_format='qcow2',id=3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1057405191',owner='e5008f198ffc44f4bcb6921ebb1f3d7c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-11T00:41:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1282628675',display_name='tempest-TestStampPattern-server-1282628675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1282628675',id=48,image_ref='3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-a1bmq0s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='96b4c31a-8116-489f-87d8-7072a0798d25',image_min_disk='1',image_min_ram='0',image_owner_id='e5008f198ffc44f4bcb6921ebb1f3d7c',image_owner_project_name='tempest-TestStampPattern-994168132',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-994168132-project-member',image_user_id='de973f825da546e7b43be4ee91123fa3',network_allocated='True',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:41:03Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=3dab62b0-a453-40cb-8b81-d50cd7eb5b21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.objects.instance [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.policy [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:41:07 user nova-compute[75279]: INFO nova.virt.block_device [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Booting with volume snapshot e3f18f3d-ce5d-4555-bd73-63b4426b6ecf at /dev/vda
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:41:07 user nova-compute[75279]:   <uuid>3dab62b0-a453-40cb-8b81-d50cd7eb5b21</uuid>
Nov 11 00:41:07 user nova-compute[75279]:   <name>instance-00000030</name>
Nov 11 00:41:07 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:41:07 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:41:07 user nova-compute[75279]:   <metadata>
Nov 11 00:41:07 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:41:07 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:name>tempest-TestStampPattern-server-1282628675</nova:name>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:41:07</nova:creationTime>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:41:07 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:41:07 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:owner>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:user uuid="de973f825da546e7b43be4ee91123fa3">tempest-TestStampPattern-994168132-project-member</nova:user>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:project uuid="e5008f198ffc44f4bcb6921ebb1f3d7c">tempest-TestStampPattern-994168132</nova:project>
Nov 11 00:41:07 user nova-compute[75279]:       </nova:owner>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:root type="image" uuid="3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd"/>
Nov 11 00:41:07 user nova-compute[75279]:       <nova:ports>
Nov 11 00:41:07 user nova-compute[75279]:         <nova:port uuid="ce64cddf-0e57-4bb4-8302-eb9cba47e2fd">
Nov 11 00:41:07 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:41:07 user nova-compute[75279]:         </nova:port>
Nov 11 00:41:07 user nova-compute[75279]:       </nova:ports>
Nov 11 00:41:07 user nova-compute[75279]:     </nova:instance>
Nov 11 00:41:07 user nova-compute[75279]:   </metadata>
Nov 11 00:41:07 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:41:07 user nova-compute[75279]:     <system>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="serial">3dab62b0-a453-40cb-8b81-d50cd7eb5b21</entry>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="uuid">3dab62b0-a453-40cb-8b81-d50cd7eb5b21</entry>
Nov 11 00:41:07 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:41:07 user nova-compute[75279]:     </system>
Nov 11 00:41:07 user nova-compute[75279]:   </sysinfo>
Nov 11 00:41:07 user nova-compute[75279]:   <os>
Nov 11 00:41:07 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:41:07 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:41:07 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:41:07 user nova-compute[75279]:   </os>
Nov 11 00:41:07 user nova-compute[75279]:   <features>
Nov 11 00:41:07 user nova-compute[75279]:     <acpi/>
Nov 11 00:41:07 user nova-compute[75279]:     <apic/>
Nov 11 00:41:07 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:41:07 user nova-compute[75279]:   </features>
Nov 11 00:41:07 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:41:07 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:41:07 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:41:07 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:41:07 user nova-compute[75279]:   </clock>
Nov 11 00:41:07 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:41:07 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:41:07 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:41:07 user nova-compute[75279]:   </cpu>
Nov 11 00:41:07 user nova-compute[75279]:   <devices>
Nov 11 00:41:07 user nova-compute[75279]:     <disk type="file" device="disk">
Nov 11 00:41:07 user nova-compute[75279]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 11 00:41:07 user nova-compute[75279]:       <source file="/opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk"/>
Nov 11 00:41:07 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:41:07 user nova-compute[75279]:     </disk>
Nov 11 00:41:07 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:41:07 user nova-compute[75279]:       <mac address="fa:16:3e:69:d9:e2"/>
Nov 11 00:41:07 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:41:07 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:41:07 user nova-compute[75279]:       <target dev="tapce64cddf-0e"/>
Nov 11 00:41:07 user nova-compute[75279]:     </interface>
Nov 11 00:41:07 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:41:07 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/console.log" append="off"/>
Nov 11 00:41:07 user nova-compute[75279]:     </serial>
Nov 11 00:41:07 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:41:07 user nova-compute[75279]:     <video>
Nov 11 00:41:07 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:41:07 user nova-compute[75279]:     </video>
Nov 11 00:41:07 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:41:07 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:41:07 user nova-compute[75279]:     </rng>
Nov 11 00:41:07 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:41:07 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:41:07 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:41:07 user nova-compute[75279]:     </memballoon>
Nov 11 00:41:07 user nova-compute[75279]:   </devices>
Nov 11 00:41:07 user nova-compute[75279]: </domain>
Nov 11 00:41:07 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1282628675',display_name='tempest-TestStampPattern-server-1282628675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1282628675',id=48,image_ref='3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-a1bmq0s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='96b4c31a-8116-489f-87d8-7072a0798d25',image_min_disk='1',image_min_ram='0',image_owner_id='e5008f198ffc44f4bcb6921ebb1f3d7c',image_owner_project_name='tempest-TestStampPattern-994168132',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-994168132-project-member',image_user_id='de973f825da546e7b43be4ee91123fa3',network_allocated='True',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:41:03Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=3dab62b0-a453-40cb-8b81-d50cd7eb5b21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG os_vif [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d1db832-18eb-5893-b6f4-725192ec6055', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce64cddf-0e, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce64cddf-0e, col_values=(('qos', UUID('005a149a-17eb-4cee-ae37-f08f3b520c0a')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce64cddf-0e, col_values=(('external_ids', {'iface-id': 'ce64cddf-0e57-4bb4-8302-eb9cba47e2fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d9:e2', 'vm-uuid': '3dab62b0-a453-40cb-8b81-d50cd7eb5b21'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:07 user nova-compute[75279]: INFO os_vif [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e')
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No VIF found with MAC fa:16:3e:69:d9:e2, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updated VIF entry in instance network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG nova.network.neutron [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:41:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-9e8d0a87-8664-4211-b5dc-3c8f78309427 req-a26bb542-b9e6-4bf2-8ba7-500bccfea885 service nova] Releasing lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Successfully created port: e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:08 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Successfully updated port: e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-changed-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Refreshing instance network info cache due to event network-changed-e937367b-193a-49fe-adac-77114dd00fd2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] Acquiring lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.network.neutron [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updating instance_info_cache with network_info: [{"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Instance network_info: |[{"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] Acquired lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:41:09 user nova-compute[75279]: DEBUG nova.network.neutron [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Refreshing network info cache for port e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:41:10 user nova-compute[75279]: DEBUG nova.network.neutron [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updated VIF entry in instance network info cache for port e937367b-193a-49fe-adac-77114dd00fd2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:41:10 user nova-compute[75279]: DEBUG nova.network.neutron [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updating instance_info_cache with network_info: [{"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:41:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6a7e0ff5-dfd3-495b-8a99-f73aca6b8b71 req-1f210e7a-e5a6-4139-bdf6-01a08d07a352 service nova] Releasing lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] No waiting events found dispatching network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:41:11 user nova-compute[75279]: WARNING nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received unexpected event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd for instance with vm_state building and task_state spawning.
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] No waiting events found dispatching network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:41:11 user nova-compute[75279]: WARNING nova.compute.manager [req-e7fe41b9-3d2d-48d7-8ba3-f829b3d4ad1a req-6e56e695-1114-4cf9-b25b-46fa847b302b service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received unexpected event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd for instance with vm_state building and task_state spawning.
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:41:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Instance spawned successfully.
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:41:11 user nova-compute[75279]: INFO nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Took 7.99 seconds to spawn the instance on the hypervisor.
Nov 11 00:41:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:41:11 user nova-compute[75279]: INFO nova.compute.manager [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Took 8.63 seconds to build instance.
Nov 11 00:41:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-46fdb47f-6050-41d9-805a-37cc9c469200 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.735s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.utils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511639a-c577-4688-90c5-60bd294e23f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25ff4e-d5b0-4d73-8148-8b8f98a18d9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1b40df-868b-4cf7-a00c-5efa44aecba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[773ce66f-0d0e-4be5-8484-cc526955c481]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:41:13 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:41:13 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc50c69-cec7-4817-83ea-1880cebf248c]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG os_brick.utils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:41:13 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updating existing volume attachment record: e0dd5f0d-d48a-4758-9a59-822c7178d7da {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:41:14 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:41:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:41:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:15 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:41:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:41:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:52 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:52 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:41:53 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Creating image(s)
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Ensure instance console log exists: /opt/stack/data/nova/instances/e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Start _get_guest_xml network_info=[{"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-11T00:40:51Z,direct_url=<?>,disk_format='qcow2',id=f9bbc169-9de0-4f21-9285-df1b75d0b1de,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2014441335',owner='688a0d377c874fd5956563906989b601',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-11T00:40:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oANOCMKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc', 'attached_at': '', 'detached_at': '', 'volume_id': '50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 'serial': '50a810f4-2dd9-4e39-a1a1-a66edddc02e4'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'e0dd5f0d-d48a-4758-9a59-822c7178d7da', 'delete_on_termination': True, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:41:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:53 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-11T00:40:51Z,direct_url=<?>,disk_format='qcow2',id=f9bbc169-9de0-4f21-9285-df1b75d0b1de,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2014441335',owner='688a0d377c874fd5956563906989b601',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-11T00:40:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oANOCMKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:41:53 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:41:53 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:41:53 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8055bee-c533-42cd-9216-ec3f5560af49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:41:53 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1357d1e-5e36-424c-ac00-73e0797ff4a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4] added
Nov 11 00:41:53 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de974c-05a6-4805-9404-2cfe40da3e10]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:53 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb0133-d83d-495d-b3a6-aa9f937dfead]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oANOCMKG {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oANOCMKG" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c90b632-b2c3-4ca0-b810-1855c2099e49]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oANOCMKG'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4f960-f2a9-4715-8c17-31fbe103f258]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcf715-69ff-4080-8c32-5d2a0c6a278e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:41:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:41:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f6eae-007d-4ca7-97aa-a3ebae8eaab3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260]
Nov 11 00:41:54 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260] successful.
Nov 11 00:41:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[75766945-c018-40a1-877c-41f41000c216]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[421218e1-7691-4165-8d5d-1c4c77738009]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:41:54 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:41:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:41:54 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:41:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84220614-21a8-4136-a33b-e36e50f56c75]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:41:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oANOCMKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23738636265386339', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738636265386339', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1099973431',id=49,image_ref='f9bbc169-9de0-4f21-9285-df1b75d0b1de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQBc1xqh28ghDzm0kh1Hk6XCeZ5mmRyp3/bW2kLW7rCBtE64e2qGPRAr0ELHUEqSk+ZoFs9w8RE9oZgs+11TCjFJsBziO7sECt0ZuJJwazKtiuIoZicv8dIUEo2YYpZng==',key_name='tempest-keypair-2072736748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-hsp3zdt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-124063847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:41:55 user nova-compute[75279]:   <uuid>e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc</uuid>
Nov 11 00:41:55 user nova-compute[75279]:   <name>instance-00000031</name>
Nov 11 00:41:55 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:41:55 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:41:55 user nova-compute[75279]:   <metadata>
Nov 11 00:41:55 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:41:55 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1099973431</nova:name>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:41:53</nova:creationTime>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:41:55 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:41:55 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:owner>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:41:55 user nova-compute[75279]:       </nova:owner>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:root type="image" uuid="f9bbc169-9de0-4f21-9285-df1b75d0b1de"/>
Nov 11 00:41:55 user nova-compute[75279]:       <nova:ports>
Nov 11 00:41:55 user nova-compute[75279]:         <nova:port uuid="e937367b-193a-49fe-adac-77114dd00fd2">
Nov 11 00:41:55 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 11 00:41:55 user nova-compute[75279]:         </nova:port>
Nov 11 00:41:55 user nova-compute[75279]:       </nova:ports>
Nov 11 00:41:55 user nova-compute[75279]:     </nova:instance>
Nov 11 00:41:55 user nova-compute[75279]:   </metadata>
Nov 11 00:41:55 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:41:55 user nova-compute[75279]:     <system>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="serial">e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc</entry>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="uuid">e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc</entry>
Nov 11 00:41:55 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:41:55 user nova-compute[75279]:     </system>
Nov 11 00:41:55 user nova-compute[75279]:   </sysinfo>
Nov 11 00:41:55 user nova-compute[75279]:   <os>
Nov 11 00:41:55 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:41:55 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:41:55 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:41:55 user nova-compute[75279]:   </os>
Nov 11 00:41:55 user nova-compute[75279]:   <features>
Nov 11 00:41:55 user nova-compute[75279]:     <acpi/>
Nov 11 00:41:55 user nova-compute[75279]:     <apic/>
Nov 11 00:41:55 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:41:55 user nova-compute[75279]:   </features>
Nov 11 00:41:55 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:41:55 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:41:55 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:41:55 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:41:55 user nova-compute[75279]:   </clock>
Nov 11 00:41:55 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:41:55 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:41:55 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:41:55 user nova-compute[75279]:   </cpu>
Nov 11 00:41:55 user nova-compute[75279]:   <devices>
Nov 11 00:41:55 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:41:55 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:41:55 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:41:55 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:41:55 user nova-compute[75279]:       <serial>50a810f4-2dd9-4e39-a1a1-a66edddc02e4</serial>
Nov 11 00:41:55 user nova-compute[75279]:     </disk>
Nov 11 00:41:55 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:41:55 user nova-compute[75279]:       <mac address="fa:16:3e:d2:50:db"/>
Nov 11 00:41:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:41:55 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:41:55 user nova-compute[75279]:       <target dev="tape937367b-19"/>
Nov 11 00:41:55 user nova-compute[75279]:     </interface>
Nov 11 00:41:55 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:41:55 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc/console.log" append="off"/>
Nov 11 00:41:55 user nova-compute[75279]:     </serial>
Nov 11 00:41:55 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:41:55 user nova-compute[75279]:     <video>
Nov 11 00:41:55 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:41:55 user nova-compute[75279]:     </video>
Nov 11 00:41:55 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:41:55 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:41:55 user nova-compute[75279]:     </rng>
Nov 11 00:41:55 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:41:55 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:41:55 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:41:55 user nova-compute[75279]:     </memballoon>
Nov 11 00:41:55 user nova-compute[75279]:   </devices>
Nov 11 00:41:55 user nova-compute[75279]: </domain>
Nov 11 00:41:55 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1099973431',id=49,image_ref='f9bbc169-9de0-4f21-9285-df1b75d0b1de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQBc1xqh28ghDzm0kh1Hk6XCeZ5mmRyp3/bW2kLW7rCBtE64e2qGPRAr0ELHUEqSk+ZoFs9w8RE9oZgs+11TCjFJsBziO7sECt0ZuJJwazKtiuIoZicv8dIUEo2YYpZng==',key_name='tempest-keypair-2072736748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-hsp3zdt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-124063847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG os_vif [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92a33c28-9e6a-56bc-ab95-136f98447a6d', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape937367b-19, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape937367b-19, col_values=(('qos', UUID('b16373cb-3994-400d-ba07-90173aa73359')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape937367b-19, col_values=(('external_ids', {'iface-id': 'e937367b-193a-49fe-adac-77114dd00fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:50:db', 'vm-uuid': 'e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:55 user nova-compute[75279]: INFO os_vif [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19')
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:41:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:d2:50:db, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:41:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] No waiting events found dispatching network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:41:57 user nova-compute[75279]: WARNING nova.compute.manager [req-263d1828-fb5e-490a-8343-0bce6818c3b7 req-0c02832f-8810-45a4-b092-a7af45fcc1ca service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received unexpected event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 for instance with vm_state building and task_state spawning.
Nov 11 00:41:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:41:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:41:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Instance spawned successfully.
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:41:58 user nova-compute[75279]: INFO nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 11 00:41:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:41:59 user nova-compute[75279]: INFO nova.compute.manager [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Took 52.22 seconds to build instance.
Nov 11 00:41:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:41:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:41:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:41:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:41:59 user nova-compute[75279]: DEBUG nova.compute.manager [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] No waiting events found dispatching network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:41:59 user nova-compute[75279]: WARNING nova.compute.manager [req-1f62c4ca-397b-4067-b11c-9a8fb9e311f5 req-947dfbf2-b5b3-4051-84d8-90ec6628dc82 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received unexpected event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 for instance with vm_state active and task_state None.
Nov 11 00:41:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-9b5d8b31-0e86-4695-9a98-07a448edc7a8 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.401s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:42:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:01 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:02 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:42:02 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:42:02 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=24.8970947265625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:42:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:42:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:42:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:42:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:42:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:42:11 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:42:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:42:11 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:42:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:42:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing instance network info cache due to event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] Acquiring lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] Acquired lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:42:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updated VIF entry in instance network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-33d31438-78ef-424a-b2be-5ebd75223493 req-02df04ac-88d4-464d-9bab-3e12145c5eac service nova] Releasing lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:42:55 user nova-compute[75279]: INFO nova.compute.manager [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Attaching volume ff20a0a9-ea05-459e-9891-6987b0280a4c to /dev/vdb
Nov 11 00:42:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.utils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ff085-4afa-41b6-90c8-229d5d021c54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccbf12-405a-418b-9ceb-6ec228610ce8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[549c24c8-607a-427f-ab87-3482574c3df5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[259bffc6-4303-49f6-ba53-4711341828cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:42:55 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:42:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b299884c-4344-4de6-b91e-be82b6e9f6ed]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG os_brick.utils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:42:55 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating existing volume attachment record: a8b11e17-46aa-47a4-97e2-a55c109c2977 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:42:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:42:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:43:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:43:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=24.88800811767578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:43:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [{"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:43:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:43:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBxOfGaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:43:19 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:43:19 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:43:19 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[34832bc2-bb00-4cc0-a693-0f79a785fee2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:43:19 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[45817eaf-165c-4403-be13-058cd339c285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c] added
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5dfb14-5e51-4b22-8cd9-4f0866d9ba7e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e71c38d-85ca-4de3-afa0-4dd27c22f2a0]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBxOfGaV {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBxOfGaV" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c0cad-d2df-4bfb-9771-8a49c617f96e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBxOfGaV'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32e637-7807-4792-bbfc-fa804492e1c7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3006ca-567a-4923-bc17-12d22601dc03]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1838c7d-5c25-4400-b48d-4a88e097150e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260]
Nov 11 00:43:19 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260] successful.
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[41609cd9-5952-4557-bd34-d541eb99662f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91900bbb-84e5-41dc-ad1a-d4f301a0322c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:19 user nova-compute[75279]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)
Nov 11 00:43:19 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:43:19 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d42c9-411c-4714-82c5-138588627704]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBxOfGaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:43:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23364333465316466', 'path': '/dev/sdd'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364333465316466', 'path': '/dev/sdd'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] attach device xml: <disk type="block" device="disk">
Nov 11 00:43:21 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:43:21 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:43:21 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:43:21 user nova-compute[75279]:   <serial>ff20a0a9-ea05-459e-9891-6987b0280a4c</serial>
Nov 11 00:43:21 user nova-compute[75279]: </disk>
Nov 11 00:43:21 user nova-compute[75279]:  {{(pid=75279) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] No VIF found with MAC fa:16:3e:69:d9:e2, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:43:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-ca31f1e3-7402-414f-ad91-08f926509b97 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.256s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:23 user nova-compute[75279]: INFO nova.compute.manager [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Detaching volume ff20a0a9-ea05-459e-9891-6987b0280a4c
Nov 11 00:43:23 user nova-compute[75279]: INFO nova.virt.block_device [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Attempting to driver detach volume ff20a0a9-ea05-459e-9891-6987b0280a4c from mountpoint /dev/vdb
Nov 11 00:43:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Attempting to detach device vdb from instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 from the persistent domain config. {{(pid=75279) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:43:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:43:23 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:43:23 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:43:23 user nova-compute[75279]:   <serial>ff20a0a9-ea05-459e-9891-6987b0280a4c</serial>
Nov 11 00:43:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:43:23 user nova-compute[75279]: </disk>
Nov 11 00:43:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:43:23 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully detached device vdb from instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 from the persistent domain config.
Nov 11 00:43:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 from the live domain config. {{(pid=75279) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.guest [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] detach device xml: <disk type="block" device="disk">
Nov 11 00:43:23 user nova-compute[75279]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:43:23 user nova-compute[75279]:   <source dev="/dev/sdd"/>
Nov 11 00:43:23 user nova-compute[75279]:   <target dev="vdb" bus="virtio"/>
Nov 11 00:43:23 user nova-compute[75279]:   <serial>ff20a0a9-ea05-459e-9891-6987b0280a4c</serial>
Nov 11 00:43:23 user nova-compute[75279]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 11 00:43:23 user nova-compute[75279]: </disk>
Nov 11 00:43:23 user nova-compute[75279]:  {{(pid=75279) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 11 00:43:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 11 00:43:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:43:43 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 is timed out.
Nov 11 00:43:43 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully detached device vdb from instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 from the live domain config.
Nov 11 00:43:43 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBxOfGaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:43:43 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4927d36c-fbb6-467f-8a0e-5f5b541767ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:43:43 user nova-compute[75279]: No targets found.
Nov 11 00:43:43 user nova-compute[75279]: iSNS:
Nov 11 00:43:43 user nova-compute[75279]: No targets found.
Nov 11 00:43:43 user nova-compute[75279]: STATIC:
Nov 11 00:43:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af
Nov 11 00:43:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:43:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:43:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4
Nov 11 00:43:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:43:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:43:43 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c
Nov 11 00:43:43 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:43:43 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:43:43 user nova-compute[75279]: FIRMWARE:
Nov 11 00:43:43 user nova-compute[75279]: No targets found.
Nov 11 00:43:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:43:43 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:43:43 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee48ab9-2736-425d-a1d7-bca9bf1cfd40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[db80b314-2f64-4ec2-93a5-6fdd4b881af8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:43 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:43 user nova-compute[75279]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)
Nov 11 00:43:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:43 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:43 user nova-compute[75279]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c (non-flash)
Nov 11 00:43:43 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0726e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c'): ({'sdd'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Removing single pathed devices sdd {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c694b-d73a-4aca-81a1-e1750ab62327]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:43 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd9c91-a7e8-43c5-8312-0947a5dc686e]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Flushing IO for device /dev/sdd {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c736d9-cfae-4fdd-b974-8942bde7d9dc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8619a08-ac02-4365-ba08-b748754cc215]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] SCSI volumes sdd have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd118893-95ba-4711-b9e7-92e3c4ef2c84]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a449aa3-686e-4da1-8154-55cb16f135c6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260]
Nov 11 00:43:44 user nova-compute[75279]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c, portal: 172.16.0.220,3260] successful.
Nov 11 00:43:44 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff20a0a9-ea05-459e-9891-6987b0280a4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0220a3-d282-4123-b4fd-c6ca6b05de61]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] <== disconnect_volume: return (298ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:43:44 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'flavor' on Instance uuid 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8c529023-e949-4eb5-83c2-e8e7a3a2ecfe tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:43:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-changed-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.compute.manager [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Refreshing instance network info cache due to event network-changed-e937367b-193a-49fe-adac-77114dd00fd2. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] Acquiring lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] Acquired lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Refreshing network info cache for port e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updated VIF entry in instance network info cache for port e937367b-193a-49fe-adac-77114dd00fd2. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.network.neutron [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updating instance_info_cache with network_info: [{"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-accebf35-eb33-4e93-8cc1-43e9fc1b37bb req-23e4ede9-3a2c-4e15-9e71-fcd484c47889 service nova] Releasing lock "refresh_cache-e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:48 user nova-compute[75279]: INFO nova.compute.manager [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Terminating instance
Nov 11 00:43:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-unplugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] No waiting events found dispatching network-vif-unplugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.compute.manager [req-0b9dbc7e-445f-471b-848d-3e3aa051ec74 req-b2ee18e3-c520-4b7d-989a-931413eb5f4b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-unplugged-e937367b-193a-49fe-adac-77114dd00fd2 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Instance destroyed successfully.
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.objects.instance [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1099973431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1099973431',id=49,image_ref='f9bbc169-9de0-4f21-9285-df1b75d0b1de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQBc1xqh28ghDzm0kh1Hk6XCeZ5mmRyp3/bW2kLW7rCBtE64e2qGPRAr0ELHUEqSk+ZoFs9w8RE9oZgs+11TCjFJsBziO7sECt0ZuJJwazKtiuIoZicv8dIUEo2YYpZng==',key_name='tempest-keypair-2072736748',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:41:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-hsp3zdt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-124063847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "e937367b-193a-49fe-adac-77114dd00fd2", "address": "fa:16:3e:d2:50:db", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape937367b-19", "ovs_interfaceid": "e937367b-193a-49fe-adac-77114dd00fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_vif [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape937367b-19, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b16373cb-3994-400d-ba07-90173aa73359) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:43:49 user nova-compute[75279]: INFO os_vif [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:50:db,bridge_name='br-int',has_traffic_filtering=True,id=e937367b-193a-49fe-adac-77114dd00fd2,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape937367b-19')
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oANOCMKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:43:49 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe36e88-d0d2-40e2-be60-9a8c90833c6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:43:49 user nova-compute[75279]: No targets found.
Nov 11 00:43:49 user nova-compute[75279]: iSNS:
Nov 11 00:43:49 user nova-compute[75279]: No targets found.
Nov 11 00:43:49 user nova-compute[75279]: STATIC:
Nov 11 00:43:49 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af
Nov 11 00:43:49 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:43:49 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:43:49 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4
Nov 11 00:43:49 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:43:49 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:43:49 user nova-compute[75279]: FIRMWARE:
Nov 11 00:43:49 user nova-compute[75279]: No targets found.
Nov 11 00:43:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:43:49 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:43:49 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1bef9e-62a1-456f-bce0-dd1953b28de8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[74340ac6-cdd7-49d1-a330-0371202ca8bd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:49 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:43:49 user nova-compute[75279]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 (non-flash)
Nov 11 00:43:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03e0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[40368df4-0bd2-4865-8afa-09772f8b4ad7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1fb251-b8a7-43e9-8ddf-ced8c00f477c]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2937690c-060e-41ca-9229-1937893ff530]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cae74f-654a-4830-8a76-3d0caf77d816]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a12886-90ac-4efa-81d9-86a56e172bdc]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fbac02-4339-466d-b2f9-eff2ab2af263]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260]
Nov 11 00:43:49 user nova-compute[75279]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4, portal: 172.16.0.220,3260] successful.
Nov 11 00:43:49 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a810f4-2dd9-4e39-a1a1-a66edddc02e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[05430eb3-2029-4002-987d-13876d9fbc53]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (301ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:43:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Deleting instance files /opt/stack/data/nova/instances/e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc_del
Nov 11 00:43:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Deletion of /opt/stack/data/nova/instances/e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc_del complete
Nov 11 00:43:49 user nova-compute[75279]: INFO nova.compute.manager [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 11 00:43:49 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:43:49 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:43:50 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:43:50 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Took 0.73 seconds to deallocate network for instance.
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] Acquiring lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] No waiting events found dispatching network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:43:51 user nova-compute[75279]: WARNING nova.compute.manager [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received unexpected event network-vif-plugged-e937367b-193a-49fe-adac-77114dd00fd2 for instance with vm_state active and task_state deleting.
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-1cdbcd93-99a4-414b-9971-8f635feacb5d req-e0c9e658-8d36-4695-b2de-f515c6ff288b service nova] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Received event network-vif-deleted-e937367b-193a-49fe-adac-77114dd00fd2 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:43:51 user nova-compute[75279]: INFO nova.compute.manager [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Took 0.95 seconds to detach 1 volumes for instance.
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc] Deleting volume: 50a810f4-2dd9-4e39-a1a1-a66edddc02e4 {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:43:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:52 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc
Nov 11 00:43:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-eec90b0c-052a-481b-9262-23ab17423824 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "e4118c1d-c20e-4ec6-9ead-f4c4f6c750cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.279s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:43:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:43:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:43:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:43:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:02 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:44:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=24.886749267578125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:44:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.compute.manager [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing instance network info cache due to event network-changed-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] Acquiring lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:13 user nova-compute[75279]: INFO nova.compute.manager [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Terminating instance
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] Acquired lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:44:13 user nova-compute[75279]: DEBUG nova.network.neutron [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Refreshing network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-unplugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] No waiting events found dispatching network-vif-unplugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.compute.manager [req-80fddc2c-d39b-4f88-98a0-6a7005470ba5 req-4a801ad2-83c1-47fd-a4b5-c82ea8de316c service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-unplugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Instance destroyed successfully.
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.objects.instance [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'resources' on Instance uuid 3dab62b0-a453-40cb-8b81-d50cd7eb5b21 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1282628675',display_name='tempest-TestStampPattern-server-1282628675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1282628675',id=48,image_ref='3b74e5bb-9231-4b8c-85e6-e50d0ab87dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:41:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-a1bmq0s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='96b4c31a-8116-489f-87d8-7072a0798d25',image_min_disk='1',image_min_ram='0',image_owner_id='e5008f198ffc44f4bcb6921ebb1f3d7c',image_owner_project_name='tempest-TestStampPattern-994168132',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-994168132-project-member',image_user_id='de973f825da546e7b43be4ee91123fa3',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:41:11Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=3dab62b0-a453-40cb-8b81-d50cd7eb5b21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG os_vif [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce64cddf-0e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005a149a-17eb-4cee-ae37-f08f3b520c0a) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:14 user nova-compute[75279]: INFO os_vif [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d9:e2,bridge_name='br-int',has_traffic_filtering=True,id=ce64cddf-0e57-4bb4-8302-eb9cba47e2fd,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce64cddf-0e')
Nov 11 00:44:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Deleting instance files /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21_del
Nov 11 00:44:14 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Deletion of /opt/stack/data/nova/instances/3dab62b0-a453-40cb-8b81-d50cd7eb5b21_del complete
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updated VIF entry in instance network info cache for port ce64cddf-0e57-4bb4-8302-eb9cba47e2fd. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.network.neutron [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [{"id": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "address": "fa:16:3e:69:d9:e2", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce64cddf-0e", "ovs_interfaceid": "ce64cddf-0e57-4bb4-8302-eb9cba47e2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-d261b7b1-08ad-4b2f-8910-311c87335d05 req-137878f4-9a0d-49e4-841e-2530c01eac18 service nova] Releasing lock "refresh_cache-3dab62b0-a453-40cb-8b81-d50cd7eb5b21" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:44:14 user nova-compute[75279]: INFO nova.compute.manager [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:44:14 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:15 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:44:15 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Took 0.46 seconds to deallocate network for instance.
Nov 11 00:44:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:15 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:44:15 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:44:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:15 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Deleted allocations for instance 3dab62b0-a453-40cb-8b81-d50cd7eb5b21
Nov 11 00:44:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-81c39f56-8cc3-4c09-9afc-1fdf0ad3cbe3 tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] Acquiring lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] Lock "3dab62b0-a453-40cb-8b81-d50cd7eb5b21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] No waiting events found dispatching network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:44:16 user nova-compute[75279]: WARNING nova.compute.manager [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received unexpected event network-vif-plugged-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd for instance with vm_state deleted and task_state None.
Nov 11 00:44:16 user nova-compute[75279]: DEBUG nova.compute.manager [req-26853db4-2fcb-47cf-86c6-94bd9b33c8cf req-3bdf752d-bb7a-4d2b-8c4f-0b8d2657f013 service nova] [instance: 3dab62b0-a453-40cb-8b81-d50cd7eb5b21] Received event network-vif-deleted-ce64cddf-0e57-4bb4-8302-eb9cba47e2fd {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:51 user nova-compute[75279]: INFO nova.compute.manager [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Terminating instance
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-unplugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] No waiting events found dispatching network-vif-unplugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-b01c05e6-055c-49cd-99e6-1dff66cade1f req-56f49130-0683-4b1e-9eec-d36b6b265d56 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-unplugged-db4c0e08-718a-4116-a315-a704dcef6896 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:44:51 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Instance destroyed successfully.
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.objects.instance [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545286547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545286547',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfxCr1ep9MYvtkzvzvxRGJ04i4FfNliSJ8+9GvHNSRxFt700ts3j2Zew3vRCQyJEoplPXZiWAke1NgVnflntXnydJXI/S31C7Im1ZLMMhD8G+HU1R7Ii0bWNZ5jYD7IeQ==',key_name='tempest-keypair-63910120',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-3umm4qmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=3ecb50a7-ec0f-4f96-8c45-ca8d45d98869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "db4c0e08-718a-4116-a315-a704dcef6896", "address": "fa:16:3e:ec:2b:15", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4c0e08-71", "ovs_interfaceid": "db4c0e08-718a-4116-a315-a704dcef6896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_vif [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb4c0e08-71, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91386ca0-46ce-443e-87f1-cceee46f5d9b) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:44:51 user nova-compute[75279]: INFO os_vif [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:2b:15,bridge_name='br-int',has_traffic_filtering=True,id=db4c0e08-718a-4116-a315-a704dcef6896,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4c0e08-71')
Nov 11 00:44:51 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJurDNTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:44:51 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b42b7be-6e51-4e14-8b36-7191e6d0dd04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:44:51 user nova-compute[75279]: No targets found.
Nov 11 00:44:51 user nova-compute[75279]: iSNS:
Nov 11 00:44:51 user nova-compute[75279]: No targets found.
Nov 11 00:44:51 user nova-compute[75279]: STATIC:
Nov 11 00:44:51 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af
Nov 11 00:44:51 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:44:51 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:44:51 user nova-compute[75279]: FIRMWARE:
Nov 11 00:44:51 user nova-compute[75279]: No targets found.
Nov 11 00:44:51 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:44:51 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:44:51 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[992bf7a0-fa3e-4f38-8bc5-0ab01df7b6bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75935d2-c3db-4dfa-b787-083065cf928d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:44:51 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af (non-flash)
Nov 11 00:44:51 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e066b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:51 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a67122-f386-4373-a1d0-c9500b62a4f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da7a21-4ffc-4055-bf6c-2974d6b8edc4]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18af3d3-4cb0-4599-b545-f4221444910a]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1c025f-60b8-4cff-b44f-c81daca84712]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a806691-c104-45e6-a4c7-43155866127b]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753798a-261f-42b5-8b55-e16167d6eb6f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260]
Nov 11 00:44:52 user nova-compute[75279]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af, portal: 172.16.0.220,3260] successful.
Nov 11 00:44:52 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f3b873-0b02-4b94-9a5f-14bcdd7398af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3221f44-77eb-416c-a6a2-1849f24f1046]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (293ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:44:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Deleting instance files /opt/stack/data/nova/instances/3ecb50a7-ec0f-4f96-8c45-ca8d45d98869_del
Nov 11 00:44:52 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Deletion of /opt/stack/data/nova/instances/3ecb50a7-ec0f-4f96-8c45-ca8d45d98869_del complete
Nov 11 00:44:52 user nova-compute[75279]: INFO nova.compute.manager [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 11 00:44:52 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:44:52 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:44:53 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Took 0.88 seconds to deallocate network for instance.
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4180d4d0-415c-4bb1-8d26-f97a3392df8a req-0cdb7189-1418-463c-b37c-a8a03caa739a service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-deleted-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:53 user nova-compute[75279]: INFO nova.compute.manager [req-4180d4d0-415c-4bb1-8d26-f97a3392df8a req-0cdb7189-1418-463c-b37c-a8a03caa739a service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Neutron deleted interface db4c0e08-718a-4116-a315-a704dcef6896; detaching it from the instance and deleting it from the info cache
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-4180d4d0-415c-4bb1-8d26-f97a3392df8a req-0cdb7189-1418-463c-b37c-a8a03caa739a service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-4180d4d0-415c-4bb1-8d26-f97a3392df8a req-0cdb7189-1418-463c-b37c-a8a03caa739a service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Detach interface failed, port_id=db4c0e08-718a-4116-a315-a704dcef6896, reason: Instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869 could not be found. {{(pid=75279) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] Acquiring lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] No waiting events found dispatching network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:44:53 user nova-compute[75279]: WARNING nova.compute.manager [req-cbe1d267-1512-4e24-b3b5-be9d444f3791 req-c3697a76-defc-4bbd-b338-fa54949e9e70 service nova] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Received unexpected event network-vif-plugged-db4c0e08-718a-4116-a315-a704dcef6896 for instance with vm_state active and task_state deleting.
Nov 11 00:44:54 user nova-compute[75279]: INFO nova.compute.manager [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Took 0.91 seconds to detach 1 volumes for instance.
Nov 11 00:44:54 user nova-compute[75279]: DEBUG nova.compute.manager [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869] Deleting volume: 54f3b873-0b02-4b94-9a5f-14bcdd7398af {{(pid=75279) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 11 00:44:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:44:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:44:54 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:44:54 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:44:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:54 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance 3ecb50a7-ec0f-4f96-8c45-ca8d45d98869
Nov 11 00:44:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-1f0ea0f3-7ad7-463f-a749-cdfeb168561a tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "3ecb50a7-ec0f-4f96-8c45-ca8d45d98869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.359s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:44:56 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:44:56 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:44:56 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:01 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:45:03 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:45:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:45:04 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=24.88703155517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance 96b4c31a-8116-489f-87d8-7072a0798d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:45:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:06 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:11 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:13 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:45:13 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:45:16 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:45:21 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing instance network info cache due to event network-changed-fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] Acquiring lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] Acquired lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.network.neutron [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Refreshing network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:29 user nova-compute[75279]: INFO nova.compute.manager [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Terminating instance
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-unplugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] No waiting events found dispatching network-vif-unplugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.compute.manager [req-b173c697-34b4-4264-922b-4cd9fc617603 req-689f7963-8d1a-4747-a789-3a0ed9502b58 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-unplugged-fa619269-4e83-4f86-a1af-98b8c50e544a for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:45:29 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Instance destroyed successfully.
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.objects.instance [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lazy-loading 'resources' on Instance uuid 96b4c31a-8116-489f-87d8-7072a0798d25 {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-14767685',display_name='tempest-TestStampPattern-server-14767685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-14767685',id=46,image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0183FxnJp1/M03dKb3aaaeuohlX68UHuTC9cY7UNO4+ZwTXriU490xxoXiF6dAPNdNy4OhL4RkTCO7mm6aUL1oCXLVZXOhDOjawXBMK/FSnPW7ORg88fVFyIhKxpakJg==',key_name='tempest-TestStampPattern-33380721',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5008f198ffc44f4bcb6921ebb1f3d7c',ramdisk_id='',reservation_id='r-v5cmx16q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='94fc9ce8-01e0-45d2-ab9d-aa4a305fabf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-994168132',owner_user_name='tempest-TestStampPattern-994168132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:41:00Z,user_data=None,user_id='de973f825da546e7b43be4ee91123fa3',uuid=96b4c31a-8116-489f-87d8-7072a0798d25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converting VIF {"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG os_vif [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa619269-4e, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e164b520-0927-4465-87a9-c7eead92f6f9) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:30 user nova-compute[75279]: INFO os_vif [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=fa619269-4e83-4f86-a1af-98b8c50e544a,network=Network(3d4cda59-4797-4997-9be5-8e51cc3cfa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa619269-4e')
Nov 11 00:45:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Deleting instance files /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25_del
Nov 11 00:45:30 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Deletion of /opt/stack/data/nova/instances/96b4c31a-8116-489f-87d8-7072a0798d25_del complete
Nov 11 00:45:30 user nova-compute[75279]: INFO nova.compute.manager [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 11 00:45:30 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.network.neutron [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updated VIF entry in instance network info cache for port fa619269-4e83-4f86-a1af-98b8c50e544a. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.network.neutron [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [{"id": "fa619269-4e83-4f86-a1af-98b8c50e544a", "address": "fa:16:3e:9a:0a:72", "network": {"id": "3d4cda59-4797-4997-9be5-8e51cc3cfa28", "bridge": "br-int", "label": "tempest-TestStampPattern-152975065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5008f198ffc44f4bcb6921ebb1f3d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa619269-4e", "ovs_interfaceid": "fa619269-4e83-4f86-a1af-98b8c50e544a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7690bd7c-a4e1-458d-a65b-10c8c7ff9711 req-2667c754-b564-4b75-b4f4-f68c378f2319 service nova] Releasing lock "refresh_cache-96b4c31a-8116-489f-87d8-7072a0798d25" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:45:30 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Took 0.47 seconds to deallocate network for instance.
Nov 11 00:45:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:45:30 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:30 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Deleted allocations for instance 96b4c31a-8116-489f-87d8-7072a0798d25
Nov 11 00:45:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-126b0c4e-1a2b-46d7-ad5b-5787df24b84f tempest-TestStampPattern-994168132 tempest-TestStampPattern-994168132-project-member] Lock "96b4c31a-8116-489f-87d8-7072a0798d25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-33a1ffa6-6f9e-41f8-a1aa-293eafb2879f req-5109df04-7121-431e-9edc-22b13727e3c8 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-deleted-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] Acquiring lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] Lock "96b4c31a-8116-489f-87d8-7072a0798d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:45:31 user nova-compute[75279]: DEBUG nova.compute.manager [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] No waiting events found dispatching network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:45:31 user nova-compute[75279]: WARNING nova.compute.manager [req-36766f06-04de-410d-9e60-9ea6e1208cd3 req-cb7a0059-ede3-46ea-a346-6461c3c1fa68 service nova] [instance: 96b4c31a-8116-489f-87d8-7072a0798d25] Received unexpected event network-vif-plugged-fa619269-4e83-4f86-a1af-98b8c50e544a for instance with vm_state deleted and task_state None.
Nov 11 00:45:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:45:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:45:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:45:57 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:45:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:46:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:46:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:46:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.01089096069336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance d5465896-56a0-4868-9343-315cd3a7c74a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:46:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.071s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:46:04 user nova-compute[75279]: INFO nova.compute.claims [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Claim successful on node user
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:46:04 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.policy [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:46:04 user nova-compute[75279]: INFO nova.virt.block_device [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Booting with volume 9886f12a-1761-463c-9479-816a4edc5278 at /dev/vda
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0e37f6-50b7-4f1e-affa-13021ca88c1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[13962699-4ee9-4ba9-a1fe-39bde67bb6e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44bcf29-2a5c-409b-a1c9-436a10bd395e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98e45a-f971-47ec-af09-a8b73ad257f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:46:04 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:46:04 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[14803ae2-e4e3-42ad-885a-579616172d0a]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG os_brick.utils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:46:04 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating existing volume attachment record: 491dabc7-700f-4577-9ece-90208105772a {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:46:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:05 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Successfully created port: 80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Successfully updated port: 80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-changed-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.compute.manager [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Refreshing instance network info cache due to event network-changed-80397f4a-82af-49b1-ad94-24cf92d19afe. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] Acquiring lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating instance_info_cache with network_info: [{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Instance network_info: |[{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] Acquired lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Refreshing network info cache for port 80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updated VIF entry in instance network info cache for port 80397f4a-82af-49b1-ad94-24cf92d19afe. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG nova.network.neutron [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating instance_info_cache with network_info: [{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:46:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-e73e1cd9-cacc-4277-835b-0c664011f328 req-81ccd0ae-35db-4b8d-b3cd-3a07ca9430ac service nova] Releasing lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:46:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:12 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:14 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:46:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:46:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Skipping network cache update for instance because it is Building. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 00:46:14 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:46:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:46:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:46:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:46:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:46:40 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Creating image(s)
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Ensure instance console log exists: /opt/stack/data/nova/instances/d5465896-56a0-4868-9343-315cd3a7c74a/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Start _get_guest_xml network_info=[{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5465896-56a0-4868-9343-315cd3a7c74a', 'attached_at': '', 'detached_at': '', 'volume_id': '9886f12a-1761-463c-9479-816a4edc5278', 'serial': '9886f12a-1761-463c-9479-816a4edc5278'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '491dabc7-700f-4577-9ece-90208105772a', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:46:40 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:46:40 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:46:40 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:46:40 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:46:40 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd6fbc-aa3d-40ba-a126-425db741dfcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:46:40 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80d8770-30fd-49ff-9373-4ebf3905fca7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278] added
Nov 11 00:46:40 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:40 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fff2d8-b94b-4d4b-a031-d93f41a4acef]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8469fb-e902-41ed-b69f-522c7dad7f09]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCZnoyqg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCZnoyqg" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0cd9c-c3ac-4ce0-a656-aad8fca9d965]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lCZnoyqg'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f647b9-9876-4eac-82e5-1e6be0ba4b32]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b3068-b9a6-48a9-9cfc-bc4c77a6371c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:46:41 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:46:41 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:46:41 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:46:41 user nova-compute[75279]: 
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1fcd7d-b854-4c75-97e8-534bf0086764]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]
Nov 11 00:46:41 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.
Nov 11 00:46:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f845c-0bce-46aa-8dbb-bf34d8fa4c50]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc2e2f-49cd-4180-8d72-7c0ec4a76fc0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:46:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:46:41 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dde499-9c0b-4792-8a80-d5456e254420]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:46:41 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23839393764343634', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839393764343634', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-875698150',display_name='tempest-TestVolumeBootPattern-server-875698150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-875698150',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-n6829jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:46:04Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=d5465896-56a0-4868-9343-315cd3a7c74a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.objects.instance [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid d5465896-56a0-4868-9343-315cd3a7c74a {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:46:42 user nova-compute[75279]:   <uuid>d5465896-56a0-4868-9343-315cd3a7c74a</uuid>
Nov 11 00:46:42 user nova-compute[75279]:   <name>instance-00000032</name>
Nov 11 00:46:42 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:46:42 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:46:42 user nova-compute[75279]:   <metadata>
Nov 11 00:46:42 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:46:42 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:46:42 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-server-875698150</nova:name>
Nov 11 00:46:42 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:46:40</nova:creationTime>
Nov 11 00:46:42 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:46:42 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:46:42 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:46:42 user nova-compute[75279]:       <nova:owner>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:46:42 user nova-compute[75279]:       </nova:owner>
Nov 11 00:46:42 user nova-compute[75279]:       <nova:ports>
Nov 11 00:46:42 user nova-compute[75279]:         <nova:port uuid="80397f4a-82af-49b1-ad94-24cf92d19afe">
Nov 11 00:46:42 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 11 00:46:42 user nova-compute[75279]:         </nova:port>
Nov 11 00:46:42 user nova-compute[75279]:       </nova:ports>
Nov 11 00:46:42 user nova-compute[75279]:     </nova:instance>
Nov 11 00:46:42 user nova-compute[75279]:   </metadata>
Nov 11 00:46:42 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:46:42 user nova-compute[75279]:     <system>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="serial">d5465896-56a0-4868-9343-315cd3a7c74a</entry>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="uuid">d5465896-56a0-4868-9343-315cd3a7c74a</entry>
Nov 11 00:46:42 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:46:42 user nova-compute[75279]:     </system>
Nov 11 00:46:42 user nova-compute[75279]:   </sysinfo>
Nov 11 00:46:42 user nova-compute[75279]:   <os>
Nov 11 00:46:42 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:46:42 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:46:42 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:46:42 user nova-compute[75279]:   </os>
Nov 11 00:46:42 user nova-compute[75279]:   <features>
Nov 11 00:46:42 user nova-compute[75279]:     <acpi/>
Nov 11 00:46:42 user nova-compute[75279]:     <apic/>
Nov 11 00:46:42 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:46:42 user nova-compute[75279]:   </features>
Nov 11 00:46:42 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:46:42 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:46:42 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:46:42 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:46:42 user nova-compute[75279]:   </clock>
Nov 11 00:46:42 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:46:42 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:46:42 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:46:42 user nova-compute[75279]:   </cpu>
Nov 11 00:46:42 user nova-compute[75279]:   <devices>
Nov 11 00:46:42 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:46:42 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:46:42 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:46:42 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:46:42 user nova-compute[75279]:       <serial>9886f12a-1761-463c-9479-816a4edc5278</serial>
Nov 11 00:46:42 user nova-compute[75279]:     </disk>
Nov 11 00:46:42 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:46:42 user nova-compute[75279]:       <mac address="fa:16:3e:3f:80:b6"/>
Nov 11 00:46:42 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:46:42 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:46:42 user nova-compute[75279]:       <target dev="tap80397f4a-82"/>
Nov 11 00:46:42 user nova-compute[75279]:     </interface>
Nov 11 00:46:42 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:46:42 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/d5465896-56a0-4868-9343-315cd3a7c74a/console.log" append="off"/>
Nov 11 00:46:42 user nova-compute[75279]:     </serial>
Nov 11 00:46:42 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:46:42 user nova-compute[75279]:     <video>
Nov 11 00:46:42 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:46:42 user nova-compute[75279]:     </video>
Nov 11 00:46:42 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:46:42 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:46:42 user nova-compute[75279]:     </rng>
Nov 11 00:46:42 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:46:42 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:46:42 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:46:42 user nova-compute[75279]:     </memballoon>
Nov 11 00:46:42 user nova-compute[75279]:   </devices>
Nov 11 00:46:42 user nova-compute[75279]: </domain>
Nov 11 00:46:42 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-875698150',display_name='tempest-TestVolumeBootPattern-server-875698150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-875698150',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-n6829jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:46:04Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=d5465896-56a0-4868-9343-315cd3a7c74a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG os_vif [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f7b03bd-d3fc-5575-a99d-a2efe29afe07', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80397f4a-82, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80397f4a-82, col_values=(('qos', UUID('2e958e0d-51d8-4657-9bb6-b14a979f7303')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80397f4a-82, col_values=(('external_ids', {'iface-id': '80397f4a-82af-49b1-ad94-24cf92d19afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:80:b6', 'vm-uuid': 'd5465896-56a0-4868-9343-315cd3a7c74a'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:42 user nova-compute[75279]: INFO os_vif [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82')
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:46:42 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:3f:80:b6, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:43 user nova-compute[75279]: DEBUG nova.compute.manager [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:46:43 user nova-compute[75279]: WARNING nova.compute.manager [req-c2c9524d-edd8-4bd0-b535-571784d53283 req-987eef92-dfb6-4a4c-819d-57c6d3dc8c8b service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state building and task_state spawning.
Nov 11 00:46:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:46:45 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Instance spawned successfully.
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:46:45 user nova-compute[75279]: INFO nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:45 user nova-compute[75279]: DEBUG nova.compute.manager [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:46:45 user nova-compute[75279]: WARNING nova.compute.manager [req-4d544524-5c75-4664-a715-e676b67f6c73 req-874e23af-73d9-4ab0-9f6b-538c5fb52f13 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state building and task_state spawning.
Nov 11 00:46:45 user nova-compute[75279]: INFO nova.compute.manager [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Took 41.91 seconds to build instance.
Nov 11 00:46:45 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-c65650be-6dce-488e-a432-c99319962cd5 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.009s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:46:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:46:58 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:46:58 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:47:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:02 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:47:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:47:03 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:47:03 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.00857925415039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:03 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance d5465896-56a0-4868-9343-315cd3a7c74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:47:04 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:47:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:07 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid d5465896-56a0-4868-9343-315cd3a7c74a {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating instance_info_cache with network_info: [{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:47:16 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:47:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:22 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:47:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Triggering sync for uuid d5465896-56a0-4868-9343-315cd3a7c74a {{(pid=75279) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 11 00:47:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:25 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:47:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:32 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:37 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:47:42 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:47 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:52 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-changed-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:47:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Refreshing instance network info cache due to event network-changed-80397f4a-82af-49b1-ad94-24cf92d19afe. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:47:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] Acquiring lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:47:55 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] Acquired lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:47:55 user nova-compute[75279]: DEBUG nova.network.neutron [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Refreshing network info cache for port 80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:47:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updated VIF entry in instance network info cache for port 80397f4a-82af-49b1-ad94-24cf92d19afe. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:47:56 user nova-compute[75279]: DEBUG nova.network.neutron [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating instance_info_cache with network_info: [{"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:47:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-c7b06ef5-dab6-4f63-b6a8-566ab0769ee7 req-69b1d2b3-a901-4c5e-a166-bb810949b6c7 service nova] Releasing lock "refresh_cache-d5465896-56a0-4868-9343-315cd3a7c74a" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:47:57 user nova-compute[75279]: INFO nova.compute.manager [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Terminating instance
Nov 11 00:47:57 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG nova.compute.manager [req-1eace8db-a631-4fe3-8bef-a23590d52a14 req-2aa0f5da-d9bc-480f-9a5e-cea9ec0e4664 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:57 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Instance destroyed successfully.
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid d5465896-56a0-4868-9343-315cd3a7c74a {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-875698150',display_name='tempest-TestVolumeBootPattern-server-875698150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-875698150',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-n6829jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:46:46Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=d5465896-56a0-4868-9343-315cd3a7c74a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "80397f4a-82af-49b1-ad94-24cf92d19afe", "address": "fa:16:3e:3f:80:b6", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80397f4a-82", "ovs_interfaceid": "80397f4a-82af-49b1-ad94-24cf92d19afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_vif [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80397f4a-82, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e958e0d-51d8-4657-9bb6-b14a979f7303) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:47:58 user nova-compute[75279]: INFO os_vif [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:b6,bridge_name='br-int',has_traffic_filtering=True,id=80397f4a-82af-49b1-ad94-24cf92d19afe,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80397f4a-82')
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:47:58 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee7fb1-62ec-4063-b83e-368c3b1ef97a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:47:58 user nova-compute[75279]: No targets found.
Nov 11 00:47:58 user nova-compute[75279]: iSNS:
Nov 11 00:47:58 user nova-compute[75279]: No targets found.
Nov 11 00:47:58 user nova-compute[75279]: STATIC:
Nov 11 00:47:58 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278
Nov 11 00:47:58 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:47:58 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:47:58 user nova-compute[75279]: FIRMWARE:
Nov 11 00:47:58 user nova-compute[75279]: No targets found.
Nov 11 00:47:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:47:58 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:47:58 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14387e-5335-4585-b531-fcbc89db73aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab3057-dd92-486e-955e-6b577d6ea3bc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:47:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:47:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e07f0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed8610-9fbd-499e-b30c-5c2cab520df4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ef62e-9366-4c36-8dff-423d630fb825]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[84874846-0dcf-46ad-a86c-84e5eca3188c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b1e93-d9a5-47f1-9f67-20952d9d42b3]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc48dec3-9428-46cc-8e50-479246917964]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c240fad-7840-4a1e-8835-3374dd38717d]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]
Nov 11 00:47:58 user nova-compute[75279]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.
Nov 11 00:47:58 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[405888b8-68ea-4d35-a52c-659656cf201d]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (332ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:47:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Deleting instance files /opt/stack/data/nova/instances/d5465896-56a0-4868-9343-315cd3a7c74a_del
Nov 11 00:47:58 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Deletion of /opt/stack/data/nova/instances/d5465896-56a0-4868-9343-315cd3a7c74a_del complete
Nov 11 00:47:58 user nova-compute[75279]: INFO nova.compute.manager [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 11 00:47:58 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:47:59 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:47:59 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Took 1.11 seconds to deallocate network for instance.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:48:00 user nova-compute[75279]: WARNING nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state active and task_state deleting.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:48:00 user nova-compute[75279]: WARNING nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state active and task_state deleting.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:48:00 user nova-compute[75279]: WARNING nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state active and task_state deleting.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-unplugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Acquiring lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] Lock "d5465896-56a0-4868-9343-315cd3a7c74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] No waiting events found dispatching network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:48:00 user nova-compute[75279]: WARNING nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received unexpected event network-vif-plugged-80397f4a-82af-49b1-ad94-24cf92d19afe for instance with vm_state active and task_state deleting.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [req-2ba9074c-5e02-4fc5-a3d8-a62813cd21fe req-b5c2a023-ff12-4e40-8d98-6d0c56d928d1 service nova] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Received event network-vif-deleted-80397f4a-82af-49b1-ad94-24cf92d19afe {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:48:00 user nova-compute[75279]: INFO nova.compute.manager [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: d5465896-56a0-4868-9343-315cd3a7c74a] Took 0.99 seconds to detach 1 volumes for instance.
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:00 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance d5465896-56a0-4868-9343-315cd3a7c74a
Nov 11 00:48:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0622f10b-41f1-4fa9-8642-6aabdd389864 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "d5465896-56a0-4868-9343-315cd3a7c74a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:01 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:48:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:48:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:48:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=25.007549285888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:48:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:48:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:48:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:48:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:48 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:48:49 user nova-compute[75279]: INFO nova.compute.claims [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Claim successful on node user
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:48:49 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:48:49 user nova-compute[75279]: INFO nova.virt.block_device [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Booting with volume 9886f12a-1761-463c-9479-816a4edc5278 at /dev/vda
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.policy [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37146e7-331e-499f-9476-5cb6e7a1f5d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd62d5-7e70-456f-b157-8b2d1b84902c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c4644-76ec-4062-81df-03eab5e5661f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[946323c8-6680-4554-8c1c-4a1a16d719d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:48:49 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:48:49 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c229c0-5214-4048-80ba-1382c2f5fc6a]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG os_brick.utils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:48:49 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating existing volume attachment record: 20932d79-b5a7-48eb-97d5-c160ce01188f {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:48:50 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Successfully created port: 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Successfully updated port: 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing instance network info cache due to event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Instance network_info: |[{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated VIF entry in instance network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:48:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-31745245-d54f-42d1-af61-a6f95266b8a3 req-bfaf344e-dfd1-4638-a387-ae2924d80809 service nova] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:48:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:48:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:00 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:03 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:49:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:49:05 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:49:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.006664276123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:49:05 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:49:06 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:49:06 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:49:06 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:49:06 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:49:12 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Creating image(s)
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Ensure instance console log exists: /opt/stack/data/nova/instances/b080132d-ebf0-4821-b0d0-d29d7d04439c/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Start _get_guest_xml network_info=[{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b080132d-ebf0-4821-b0d0-d29d7d04439c', 'attached_at': '', 'detached_at': '', 'volume_id': '9886f12a-1761-463c-9479-816a4edc5278', 'serial': '9886f12a-1761-463c-9479-816a4edc5278'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '20932d79-b5a7-48eb-97d5-c160ce01188f', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:49:12 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:49:12 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:49:12 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:49:12 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:49:12 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f75b83-46e4-4945-9c38-eba18ad1463b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:49:12 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be0b35-8c9c-40c6-9bd2-0d135f5d318d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278] added
Nov 11 00:49:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372b945-b35b-4161-bd9a-ce764bdac051]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a37c02-169b-4fce-b020-ab76481b97e1]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCZnoyqg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCZnoyqg" returned: 0 in 0.037s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[db329f07-d134-4fe9-883a-b0c3ad787b64]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lCZnoyqg'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62e465-50d9-40dd-b5af-f448dbb68111]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e992c-8f68-443c-88d6-519a5ffc83c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:49:12 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 11 00:49:12 user nova-compute[75279]:  {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:49:12 user nova-compute[75279]: WARNING os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 11 00:49:12 user nova-compute[75279]: 
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c7133-3a8e-41b6-be72-932c4fa44f49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]
Nov 11 00:49:12 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.
Nov 11 00:49:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0861dd-57c4-4dc8-bb0f-531461393aa5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be805e-21ae-4519-9b04-d2556245b890]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:49:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:49:12 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f014263-927f-4ecb-a141-6b8d41a93035]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:49:12 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23839393764343634', 'path': '/dev/sdb'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839393764343634', 'path': '/dev/sdb'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823010102',display_name='tempest-TestVolumeBootPattern-server-823010102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823010102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-pqm50le0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:48:49Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=b080132d-ebf0-4821-b0d0-d29d7d04439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.objects.instance [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:49:13 user nova-compute[75279]:   <uuid>b080132d-ebf0-4821-b0d0-d29d7d04439c</uuid>
Nov 11 00:49:13 user nova-compute[75279]:   <name>instance-00000033</name>
Nov 11 00:49:13 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:49:13 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:49:13 user nova-compute[75279]:   <metadata>
Nov 11 00:49:13 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:49:13 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:49:13 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-server-823010102</nova:name>
Nov 11 00:49:13 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:49:12</nova:creationTime>
Nov 11 00:49:13 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:49:13 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:49:13 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:49:13 user nova-compute[75279]:       <nova:owner>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:49:13 user nova-compute[75279]:       </nova:owner>
Nov 11 00:49:13 user nova-compute[75279]:       <nova:ports>
Nov 11 00:49:13 user nova-compute[75279]:         <nova:port uuid="9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb">
Nov 11 00:49:13 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 11 00:49:13 user nova-compute[75279]:         </nova:port>
Nov 11 00:49:13 user nova-compute[75279]:       </nova:ports>
Nov 11 00:49:13 user nova-compute[75279]:     </nova:instance>
Nov 11 00:49:13 user nova-compute[75279]:   </metadata>
Nov 11 00:49:13 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:49:13 user nova-compute[75279]:     <system>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="serial">b080132d-ebf0-4821-b0d0-d29d7d04439c</entry>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="uuid">b080132d-ebf0-4821-b0d0-d29d7d04439c</entry>
Nov 11 00:49:13 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:49:13 user nova-compute[75279]:     </system>
Nov 11 00:49:13 user nova-compute[75279]:   </sysinfo>
Nov 11 00:49:13 user nova-compute[75279]:   <os>
Nov 11 00:49:13 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:49:13 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:49:13 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:49:13 user nova-compute[75279]:   </os>
Nov 11 00:49:13 user nova-compute[75279]:   <features>
Nov 11 00:49:13 user nova-compute[75279]:     <acpi/>
Nov 11 00:49:13 user nova-compute[75279]:     <apic/>
Nov 11 00:49:13 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:49:13 user nova-compute[75279]:   </features>
Nov 11 00:49:13 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:49:13 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:49:13 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:49:13 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:49:13 user nova-compute[75279]:   </clock>
Nov 11 00:49:13 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:49:13 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:49:13 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:49:13 user nova-compute[75279]:   </cpu>
Nov 11 00:49:13 user nova-compute[75279]:   <devices>
Nov 11 00:49:13 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:49:13 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:49:13 user nova-compute[75279]:       <source dev="/dev/sdb"/>
Nov 11 00:49:13 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:49:13 user nova-compute[75279]:       <serial>9886f12a-1761-463c-9479-816a4edc5278</serial>
Nov 11 00:49:13 user nova-compute[75279]:     </disk>
Nov 11 00:49:13 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:49:13 user nova-compute[75279]:       <mac address="fa:16:3e:20:83:84"/>
Nov 11 00:49:13 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:49:13 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:49:13 user nova-compute[75279]:       <target dev="tap9a9bf84d-48"/>
Nov 11 00:49:13 user nova-compute[75279]:     </interface>
Nov 11 00:49:13 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:49:13 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/b080132d-ebf0-4821-b0d0-d29d7d04439c/console.log" append="off"/>
Nov 11 00:49:13 user nova-compute[75279]:     </serial>
Nov 11 00:49:13 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:49:13 user nova-compute[75279]:     <video>
Nov 11 00:49:13 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:49:13 user nova-compute[75279]:     </video>
Nov 11 00:49:13 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:49:13 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:49:13 user nova-compute[75279]:     </rng>
Nov 11 00:49:13 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:49:13 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:49:13 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:49:13 user nova-compute[75279]:     </memballoon>
Nov 11 00:49:13 user nova-compute[75279]:   </devices>
Nov 11 00:49:13 user nova-compute[75279]: </domain>
Nov 11 00:49:13 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823010102',display_name='tempest-TestVolumeBootPattern-server-823010102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823010102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-pqm50le0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:48:49Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=b080132d-ebf0-4821-b0d0-d29d7d04439c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG os_vif [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ea80b87-141f-54df-90f2-dcadaa2af543', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9bf84d-48, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a9bf84d-48, col_values=(('qos', UUID('669a06e2-819f-468d-877a-8075e0327ab8')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a9bf84d-48, col_values=(('external_ids', {'iface-id': '9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:83:84', 'vm-uuid': 'b080132d-ebf0-4821-b0d0-d29d7d04439c'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:13 user nova-compute[75279]: INFO os_vif [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48')
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:49:13 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:20:83:84, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG nova.compute.manager [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] No waiting events found dispatching network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:49:15 user nova-compute[75279]: WARNING nova.compute.manager [req-a22aba25-9210-4c74-bd03-f3fc73e30698 req-78eb9b5f-3762-4659-8f4b-8355f520e4c8 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received unexpected event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb for instance with vm_state building and task_state spawning.
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:49:17 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Instance spawned successfully.
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.compute.manager [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] No waiting events found dispatching network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:49:17 user nova-compute[75279]: WARNING nova.compute.manager [req-215b1623-a7cb-42d6-9069-cf22701ce000 req-c15683c8-63c4-4ff7-9286-3bc8d4b79b90 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received unexpected event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb for instance with vm_state building and task_state spawning.
Nov 11 00:49:17 user nova-compute[75279]: INFO nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 11 00:49:17 user nova-compute[75279]: DEBUG nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:49:17 user nova-compute[75279]: INFO nova.compute.manager [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Took 28.55 seconds to build instance.
Nov 11 00:49:17 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-0f9517bf-4dcf-4757-a194-d00d8cbb8402 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.649s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:49:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:49:19 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:49:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:49:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:49:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:02 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:02 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:50:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:50:07 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:50:07 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=24.98965072631836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:50:07 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:14 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:50:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:50:21 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:50:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:33 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:50:38 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:50:40 user nova-compute[75279]: DEBUG nova.compute.manager [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing instance network info cache due to event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:50:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:50:40 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:50:40 user nova-compute[75279]: DEBUG nova.network.neutron [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:50:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated VIF entry in instance network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:50:41 user nova-compute[75279]: DEBUG nova.network.neutron [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:50:41 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6083e43d-0021-4065-a4e8-2073be0519b6 req-e567ca5f-d4ff-4013-bd1d-cc9558ac0090 service nova] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:50:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Starting instance... {{(pid=75279) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:50:59 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75279) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 11 00:50:59 user nova-compute[75279]: INFO nova.compute.claims [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Claim successful on node user
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Start building networks asynchronously for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Allocating IP information in the background. {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] allocate_for_instance() {{(pid=75279) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 11 00:51:00 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Start building block device mappings for instance. {{(pid=75279) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.policy [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d8ce0e30fdc48b69be55bb29f73a6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688a0d377c874fd5956563906989b601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75279) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 11 00:51:00 user nova-compute[75279]: INFO nova.virt.block_device [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Booting with volume 31a93806-c429-463f-b599-83966b87e117 at /dev/vda
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.utils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccedf5-fd4d-4161-9464-c9dddda7de64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6362d14f72a8\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd6ec29-716e-41d3-ac16-68c9edca220f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[58417605-6028-4ff5-9ade-9517c9c202fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bc8168-d6f9-4f74-a1f9-8e4fc2dcedc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Running cmd (subprocess): nvme version {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] nvme not present on system {{(pid=75279) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 11 00:51:00 user nova-compute[75279]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 11 00:51:00 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a716866-3a46-415d-8bfa-62f0ddd5ab2d]: (4, '') {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75279) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.lightos [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] LIGHTOS: no hostnqn found. {{(pid=75279) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG os_brick.utils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6362d14f72a8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.virt.block_device [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating existing volume attachment record: 93a40e36-d624-4e57-ad6b-0ab2b21637c1 {{(pid=75279) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 11 00:51:00 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Successfully created port: 74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Successfully updated port: 74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquired lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Building network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-changed-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.compute.manager [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing instance network info cache due to event network-changed-74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] Acquiring lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Instance cache missing network info. {{(pid=75279) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating instance_info_cache with network_info: [{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Releasing lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Instance network_info: |[{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75279) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] Acquired lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:51:01 user nova-compute[75279]: DEBUG nova.network.neutron [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing network info cache for port 74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:51:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updated VIF entry in instance network info cache for port 74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:51:02 user nova-compute[75279]: DEBUG nova.network.neutron [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating instance_info_cache with network_info: [{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:51:02 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-da25bb05-b3bc-41e2-bdeb-0ca6146554bf req-b3413adb-a73a-4aaa-a95f-f01e3dce631f service nova] Releasing lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:51:03 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:04 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:04 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:51:05 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:51:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:51:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.988513946533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance db85f728-b418-4e53-8530-12d6d535e34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:51:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:51:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:51:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:51:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:51:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:13 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:13 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:13 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:18 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Skipping network cache update for instance because it is Building. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:51:22 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Start spawning the instance on the hypervisor. {{(pid=75279) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Creating instance directory {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 11 00:51:23 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Creating image(s)
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Did not create local disks {{(pid=75279) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Ensure instance console log exists: /opt/stack/data/nova/instances/db85f728-b418-4e53-8530-12d6d535e34b/console.log {{(pid=75279) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Start _get_guest_xml network_info=[{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgBLMICl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db85f728-b418-4e53-8530-12d6d535e34b', 'attached_at': '', 'detached_at': '', 'volume_id': '31a93806-c429-463f-b599-83966b87e117', 'serial': '31a93806-c429-463f-b599-83966b87e117'}, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '93a40e36-d624-4e57-ad6b-0ab2b21637c1', 'delete_on_termination': False, 'volume_type': None} {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 11 00:51:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:51:23 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller missing on host. {{(pid=75279) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.host [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU controller found on host. {{(pid=75279) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75279) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T23:55:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image limits 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flavor pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Image pref 0:0:0 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Got 1 possible topologies {{(pid=75279) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.hardware [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75279) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Calling os-brick to attach iSCSI Volume {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgBLMICl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:51:23 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:51:23 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:51:23 user nova-compute[75279]: INFO os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 11 00:51:23 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec999a2d-648b-4f51-b7da-ea6b81a814c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 11 00:51:23 user nova-compute[75279]:  {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --interface default --op new {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27cf78-1a6d-419c-99bc-1e5aa4e44fe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117] added\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117] added
Nov 11 00:51:23 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:23 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a95e8cc-662f-43ad-80a7-e0efe18302b7]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff5af4-3a6d-4dd1-8d70-1264d7888b51]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgBLMICl {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgBLMICl" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad7af9-2fae-400b-b6ce-c47ce57b17ad]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgBLMICl'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[55396d2c-980a-4b32-9d0b-d6058d05aac6]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085689c-765b-473b-9f5f-bf950a6673d5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --login {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[11260b3e-d89e-41b9-986c-8b27561d578d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260]
Nov 11 00:51:24 user nova-compute[75279]: Login to [iface: default, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260] successful.
Nov 11 00:51:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c433704f-1eb3-458f-9bd0-f6d623cace71]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab91725b-a72f-47fa-875e-ee06b3cb3a0e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)
Nov 11 00:51:24 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to 172.16.0.220:3260 {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75279) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75279) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca883bdd-ff25-462a-b782-b7f3daca0fa4]: (4, ('- - 0', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75279) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 11 00:51:24 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgBLMICl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75279) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23333643661373937', 'path': '/dev/sdc'} {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333643661373937', 'path': '/dev/sdc'} {{(pid=75279) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060416471',display_name='tempest-TestVolumeBootPattern-server-1060416471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060416471',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-z2vldvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:51:00Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=db85f728-b418-4e53-8530-12d6d535e34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75279) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'pci_devices' on Instance uuid db85f728-b418-4e53-8530-12d6d535e34b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] End _get_guest_xml xml=<domain type="kvm">
Nov 11 00:51:25 user nova-compute[75279]:   <uuid>db85f728-b418-4e53-8530-12d6d535e34b</uuid>
Nov 11 00:51:25 user nova-compute[75279]:   <name>instance-00000034</name>
Nov 11 00:51:25 user nova-compute[75279]:   <memory>524288</memory>
Nov 11 00:51:25 user nova-compute[75279]:   <vcpu>1</vcpu>
Nov 11 00:51:25 user nova-compute[75279]:   <metadata>
Nov 11 00:51:25 user nova-compute[75279]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 11 00:51:25 user nova-compute[75279]:       <nova:package version="0.0.0"/>
Nov 11 00:51:25 user nova-compute[75279]:       <nova:name>tempest-TestVolumeBootPattern-server-1060416471</nova:name>
Nov 11 00:51:25 user nova-compute[75279]:       <nova:creationTime>2023-11-11 00:51:23</nova:creationTime>
Nov 11 00:51:25 user nova-compute[75279]:       <nova:flavor name="m1.tiny">
Nov 11 00:51:25 user nova-compute[75279]:         <nova:memory>512</nova:memory>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:disk>1</nova:disk>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:swap>0</nova:swap>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:ephemeral>0</nova:ephemeral>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:vcpus>1</nova:vcpus>
Nov 11 00:51:25 user nova-compute[75279]:       </nova:flavor>
Nov 11 00:51:25 user nova-compute[75279]:       <nova:owner>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:user uuid="7d8ce0e30fdc48b69be55bb29f73a6f9">tempest-TestVolumeBootPattern-124063847-project-member</nova:user>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:project uuid="688a0d377c874fd5956563906989b601">tempest-TestVolumeBootPattern-124063847</nova:project>
Nov 11 00:51:25 user nova-compute[75279]:       </nova:owner>
Nov 11 00:51:25 user nova-compute[75279]:       <nova:ports>
Nov 11 00:51:25 user nova-compute[75279]:         <nova:port uuid="74df2842-6538-40c9-8cab-f6035f087897">
Nov 11 00:51:25 user nova-compute[75279]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 11 00:51:25 user nova-compute[75279]:         </nova:port>
Nov 11 00:51:25 user nova-compute[75279]:       </nova:ports>
Nov 11 00:51:25 user nova-compute[75279]:     </nova:instance>
Nov 11 00:51:25 user nova-compute[75279]:   </metadata>
Nov 11 00:51:25 user nova-compute[75279]:   <sysinfo type="smbios">
Nov 11 00:51:25 user nova-compute[75279]:     <system>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="product">OpenStack Nova</entry>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="version">0.0.0</entry>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="serial">db85f728-b418-4e53-8530-12d6d535e34b</entry>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="uuid">db85f728-b418-4e53-8530-12d6d535e34b</entry>
Nov 11 00:51:25 user nova-compute[75279]:       <entry name="family">Virtual Machine</entry>
Nov 11 00:51:25 user nova-compute[75279]:     </system>
Nov 11 00:51:25 user nova-compute[75279]:   </sysinfo>
Nov 11 00:51:25 user nova-compute[75279]:   <os>
Nov 11 00:51:25 user nova-compute[75279]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 11 00:51:25 user nova-compute[75279]:     <boot dev="hd"/>
Nov 11 00:51:25 user nova-compute[75279]:     <smbios mode="sysinfo"/>
Nov 11 00:51:25 user nova-compute[75279]:   </os>
Nov 11 00:51:25 user nova-compute[75279]:   <features>
Nov 11 00:51:25 user nova-compute[75279]:     <acpi/>
Nov 11 00:51:25 user nova-compute[75279]:     <apic/>
Nov 11 00:51:25 user nova-compute[75279]:     <vmcoreinfo/>
Nov 11 00:51:25 user nova-compute[75279]:   </features>
Nov 11 00:51:25 user nova-compute[75279]:   <clock offset="utc">
Nov 11 00:51:25 user nova-compute[75279]:     <timer name="pit" tickpolicy="delay"/>
Nov 11 00:51:25 user nova-compute[75279]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 11 00:51:25 user nova-compute[75279]:     <timer name="hpet" present="no"/>
Nov 11 00:51:25 user nova-compute[75279]:   </clock>
Nov 11 00:51:25 user nova-compute[75279]:   <cpu mode="custom" match="exact">
Nov 11 00:51:25 user nova-compute[75279]:     <model>Nehalem</model>
Nov 11 00:51:25 user nova-compute[75279]:     <topology sockets="1" cores="1" threads="1"/>
Nov 11 00:51:25 user nova-compute[75279]:   </cpu>
Nov 11 00:51:25 user nova-compute[75279]:   <devices>
Nov 11 00:51:25 user nova-compute[75279]:     <disk type="block" device="disk">
Nov 11 00:51:25 user nova-compute[75279]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 11 00:51:25 user nova-compute[75279]:       <source dev="/dev/sdc"/>
Nov 11 00:51:25 user nova-compute[75279]:       <target dev="vda" bus="virtio"/>
Nov 11 00:51:25 user nova-compute[75279]:       <serial>31a93806-c429-463f-b599-83966b87e117</serial>
Nov 11 00:51:25 user nova-compute[75279]:     </disk>
Nov 11 00:51:25 user nova-compute[75279]:     <interface type="ethernet">
Nov 11 00:51:25 user nova-compute[75279]:       <mac address="fa:16:3e:e7:cd:26"/>
Nov 11 00:51:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:51:25 user nova-compute[75279]:       <mtu size="1442"/>
Nov 11 00:51:25 user nova-compute[75279]:       <target dev="tap74df2842-65"/>
Nov 11 00:51:25 user nova-compute[75279]:     </interface>
Nov 11 00:51:25 user nova-compute[75279]:     <serial type="pty">
Nov 11 00:51:25 user nova-compute[75279]:       <log file="/opt/stack/data/nova/instances/db85f728-b418-4e53-8530-12d6d535e34b/console.log" append="off"/>
Nov 11 00:51:25 user nova-compute[75279]:     </serial>
Nov 11 00:51:25 user nova-compute[75279]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 11 00:51:25 user nova-compute[75279]:     <video>
Nov 11 00:51:25 user nova-compute[75279]:       <model type="virtio"/>
Nov 11 00:51:25 user nova-compute[75279]:     </video>
Nov 11 00:51:25 user nova-compute[75279]:     <rng model="virtio">
Nov 11 00:51:25 user nova-compute[75279]:       <backend model="random">/dev/urandom</backend>
Nov 11 00:51:25 user nova-compute[75279]:     </rng>
Nov 11 00:51:25 user nova-compute[75279]:     <controller type="usb" index="0" model="none"/>
Nov 11 00:51:25 user nova-compute[75279]:     <memballoon model="virtio">
Nov 11 00:51:25 user nova-compute[75279]:       <stats period="10"/>
Nov 11 00:51:25 user nova-compute[75279]:     </memballoon>
Nov 11 00:51:25 user nova-compute[75279]:   </devices>
Nov 11 00:51:25 user nova-compute[75279]: </domain>
Nov 11 00:51:25 user nova-compute[75279]:  {{(pid=75279) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060416471',display_name='tempest-TestVolumeBootPattern-server-1060416471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060416471',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-z2vldvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-11T00:51:00Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=db85f728-b418-4e53-8530-12d6d535e34b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG os_vif [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65') {{(pid=75279) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e7f5706-d62d-5aa5-9fb3-f35905921634', '_type': 'linux-noop'}}, row=False) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74df2842-65, may_exist=True, interface_attrs={}) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74df2842-65, col_values=(('qos', UUID('324e8684-58a2-49fb-a1cd-f99cb53e3c7e')),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74df2842-65, col_values=(('external_ids', {'iface-id': '74df2842-6538-40c9-8cab-f6035f087897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:cd:26', 'vm-uuid': 'db85f728-b418-4e53-8530-12d6d535e34b'}),), if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:25 user nova-compute[75279]: INFO os_vif [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65')
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75279) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 11 00:51:25 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] No VIF found with MAC fa:16:3e:e7:cd:26, not building metadata {{(pid=75279) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:26 user nova-compute[75279]: DEBUG nova.compute.manager [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] No waiting events found dispatching network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:51:26 user nova-compute[75279]: WARNING nova.compute.manager [req-46e53a6a-2583-4112-a7da-675a84207a34 req-1f6395e0-a9a6-41a4-abdc-98e7dc61f428 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received unexpected event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 for instance with vm_state building and task_state spawning.
Nov 11 00:51:27 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75279) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Instance event wait completed in 0 seconds for  {{(pid=75279) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Guest created on hypervisor {{(pid=75279) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 11 00:51:28 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Instance spawned successfully.
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_cdrom_bus of ide {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_disk_bus of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_input_bus of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_pointer_model of None {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_video_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Found default for hw_vif_model of virtio {{(pid=75279) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 11 00:51:28 user nova-compute[75279]: INFO nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Checking state {{(pid=75279) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 11 00:51:28 user nova-compute[75279]: INFO nova.compute.manager [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Took 28.97 seconds to build instance.
Nov 11 00:51:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8cf741e9-ae37-4e48-9f52-09a12af6cd33 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.145s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:51:28 user nova-compute[75279]: DEBUG nova.compute.manager [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] No waiting events found dispatching network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:51:28 user nova-compute[75279]: WARNING nova.compute.manager [req-3fe5eabd-d830-41c1-8b8f-f41d41b8fa5a req-9c86e230-e55a-487d-b106-ff445564ee19 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received unexpected event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 for instance with vm_state active and task_state None.
Nov 11 00:51:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:36 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:51:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Cleaning up deleted instances {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 11 00:51:36 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] There are 0 instances to clean {{(pid=75279) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 11 00:51:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:51:43 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:48 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:51:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:06 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:06 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:52:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:52:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:52:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:52:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.987152099609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance db85f728-b418-4e53-8530-12d6d535e34b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing inventories for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating ProviderTree inventory for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Updating inventory in ProviderTree for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing aggregate associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, aggregates: None {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Refreshing trait associations for resource provider d9002de1-9e35-4b13-abf3-b4c27ac7a991, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75279) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:52:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Forcefully refreshing network info cache for instance {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 11 00:52:22 user nova-compute[75279]: DEBUG nova.objects.instance [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lazy-loading 'info_cache' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:52:23 user nova-compute[75279]: DEBUG nova.network.neutron [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:52:23 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:52:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated the network info_cache for instance {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:52:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-changed-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:52:51 user nova-compute[75279]: DEBUG nova.compute.manager [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing instance network info cache due to event network-changed-74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:52:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] Acquiring lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:52:51 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] Acquired lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:52:51 user nova-compute[75279]: DEBUG nova.network.neutron [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing network info cache for port 74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:52:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updated VIF entry in instance network info cache for port 74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:52:52 user nova-compute[75279]: DEBUG nova.network.neutron [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating instance_info_cache with network_info: [{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:52:52 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-43fbcc5e-51e8-458e-9dc2-61153dd67ff1 req-faa431a5-3a27-4250-90c5-d9b8469fa933 service nova] Releasing lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-changed-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG nova.compute.manager [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing instance network info cache due to event network-changed-74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] Acquiring lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] Acquired lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Refreshing network info cache for port 74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:53 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:53 user nova-compute[75279]: INFO nova.compute.manager [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Terminating instance
Nov 11 00:52:53 user nova-compute[75279]: DEBUG nova.compute.manager [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-unplugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] No waiting events found dispatching network-vif-unplugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.compute.manager [req-8db5d2a9-2ce7-44a8-8034-1c2bb72b43b7 req-edce049c-b00c-4a5b-95b7-b7493e58145a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-unplugged-74df2842-6538-40c9-8cab-f6035f087897 for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updated VIF entry in instance network info cache for port 74df2842-6538-40c9-8cab-f6035f087897. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.network.neutron [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating instance_info_cache with network_info: [{"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-8b5aba32-436a-435a-9d67-055a1d15e6c2 req-5169bb4e-0876-4114-95e9-0dddec36891a service nova] Releasing lock "refresh_cache-db85f728-b418-4e53-8530-12d6d535e34b" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Instance destroyed successfully.
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.objects.instance [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid db85f728-b418-4e53-8530-12d6d535e34b {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1060416471',display_name='tempest-TestVolumeBootPattern-server-1060416471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1060416471',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:51:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-z2vldvv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:51:29Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=db85f728-b418-4e53-8530-12d6d535e34b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "74df2842-6538-40c9-8cab-f6035f087897", "address": "fa:16:3e:e7:cd:26", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74df2842-65", "ovs_interfaceid": "74df2842-6538-40c9-8cab-f6035f087897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_vif [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74df2842-65, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=324e8684-58a2-49fb-a1cd-f99cb53e3c7e) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:52:54 user nova-compute[75279]: INFO os_vif [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:cd:26,bridge_name='br-int',has_traffic_filtering=True,id=74df2842-6538-40c9-8cab-f6035f087897,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74df2842-65')
Nov 11 00:52:54 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgBLMICl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:52:54 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4385e-f5cb-4484-9d75-21d6dfc68d88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:52:54 user nova-compute[75279]: No targets found.
Nov 11 00:52:54 user nova-compute[75279]: iSNS:
Nov 11 00:52:54 user nova-compute[75279]: No targets found.
Nov 11 00:52:54 user nova-compute[75279]: STATIC:
Nov 11 00:52:54 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117
Nov 11 00:52:54 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:52:54 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:52:54 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278
Nov 11 00:52:54 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:52:54 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:52:54 user nova-compute[75279]: FIRMWARE:
Nov 11 00:52:54 user nova-compute[75279]: No targets found.
Nov 11 00:52:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:52:54 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:52:54 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cfad02-0eb1-401e-b82b-0252bf3da7f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[8277d883-5783-4fc7-8e87-f7255cfa5bff]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:52:54 user nova-compute[75279]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)
Nov 11 00:52:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:52:54 user nova-compute[75279]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 (non-flash)
Nov 11 00:52:54 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e03a8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117'): ({'sdc'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdc {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d9fe7-55ca-4576-9f65-62fd0908fa1c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3bd2d-cf65-4115-a1d5-80eea8b9b279]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdc {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002a10b-19b1-416f-a10a-59b286524e88]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187c8b6-deaf-445c-b5c5-975280cfcd20]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdc have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a6d9ec12', '/dev/disk/by-id/scsi-23333643661373937', '/dev/disk/by-id/scsi-1SCST_BIOa6d9ec12-33d6a7970db0d55b') {{(pid=86651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b74fa7f-187e-476f-9312-ba0a83375a94]: (4, None) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[096027de-920e-45ce-a829-9d8b5aea4b3e]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:52:54 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94cb39e-dc16-49a2-8691-865a9a5783f9]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260]
Nov 11 00:52:55 user nova-compute[75279]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117, portal: 172.16.0.220,3260] successful.
Nov 11 00:52:55 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a93806-c429-463f-b599-83966b87e117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc9f98b-8f8d-4583-aba2-3a26785f046c]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (312ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:52:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Deleting instance files /opt/stack/data/nova/instances/db85f728-b418-4e53-8530-12d6d535e34b_del
Nov 11 00:52:55 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Deletion of /opt/stack/data/nova/instances/db85f728-b418-4e53-8530-12d6d535e34b_del complete
Nov 11 00:52:55 user nova-compute[75279]: INFO nova.compute.manager [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 11 00:52:55 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:52:55 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:52:55 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Took 0.62 seconds to deallocate network for instance.
Nov 11 00:52:55 user nova-compute[75279]: DEBUG nova.compute.manager [req-96031f5e-7b5a-490d-8d76-542cb5d24a9b req-dc51f23e-6349-475d-b080-2cf7093aba9e service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-deleted-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] Acquiring lock "db85f728-b418-4e53-8530-12d6d535e34b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] Lock "db85f728-b418-4e53-8530-12d6d535e34b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG nova.compute.manager [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] No waiting events found dispatching network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:52:56 user nova-compute[75279]: WARNING nova.compute.manager [req-6e0ab4db-3a08-40f1-83f5-d92863c4bbb3 req-cdaa2324-89fb-4e5e-be43-de5e7a468a93 service nova] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Received unexpected event network-vif-plugged-74df2842-6538-40c9-8cab-f6035f087897 for instance with vm_state active and task_state deleting.
Nov 11 00:52:56 user nova-compute[75279]: INFO nova.compute.manager [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: db85f728-b418-4e53-8530-12d6d535e34b] Took 1.00 seconds to detach 1 volumes for instance.
Nov 11 00:52:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:52:56 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:52:57 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:52:57 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:52:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:57 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance db85f728-b418-4e53-8530-12d6d535e34b
Nov 11 00:52:57 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-53737a50-3077-423c-a9c2-4ee715ce6bc9 tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "db85f728-b418-4e53-8530-12d6d535e34b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:52:58 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:52:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:07 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:07 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:53:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:53:08 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:53:08 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.978469848632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:53:08 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:53:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:17 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:19 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:23 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:53:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:53:23 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:53:24 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:29 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:34 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:39 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:44 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:49 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:53:54 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:53:59 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:04 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:08 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:08 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG nova.compute.manager [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing instance network info cache due to event network-changed-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] Acquiring lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] Acquired lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 11 00:54:09 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Refreshing network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:10 user nova-compute[75279]: INFO nova.compute.manager [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Terminating instance
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.compute.manager [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Start destroying the instance on the hypervisor. {{(pid=75279) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-unplugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] No waiting events found dispatching network-vif-unplugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.compute.manager [req-bd21c035-eff7-4590-bcce-772685b8f150 req-60af125e-e8ab-46ce-abc4-bdf7f9697b28 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-unplugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb for instance with task_state deleting. {{(pid=75279) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updated VIF entry in instance network info cache for port 9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb. {{(pid=75279) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.network.neutron [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [{"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-7a9fb2d3-4e6c-434b-8f88-490439395f56 req-85a22617-2fc1-4b27-8b70-8d1a45774daa service nova] Releasing lock "refresh_cache-b080132d-ebf0-4821-b0d0-d29d7d04439c" {{(pid=75279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 11 00:54:10 user nova-compute[75279]: INFO nova.virt.libvirt.driver [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Instance destroyed successfully.
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.objects.instance [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lazy-loading 'resources' on Instance uuid b080132d-ebf0-4821-b0d0-d29d7d04439c {{(pid=75279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.vif [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-11T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-823010102',display_name='tempest-TestVolumeBootPattern-server-823010102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-823010102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6sKBtYKvag2nAD87PejGeblsK5cA0GLN/qbKyeMSNJBbRPeB5fwBuSqn/SsgmkA6+4heHEVQbXxEXTS4dtyyvCV4LNcnLEvznIRJlCNjHyw86Khy0HcWZIXwJ+jshDWw==',key_name='tempest-TestVolumeBootPattern-1861523805',keypairs=<?>,launch_index=0,launched_at=2023-11-11T00:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688a0d377c874fd5956563906989b601',ramdisk_id='',reservation_id='r-pqm50le0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-124063847',owner_user_name='tempest-TestVolumeBootPattern-124063847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-11T00:49:18Z,user_data=None,user_id='7d8ce0e30fdc48b69be55bb29f73a6f9',uuid=b080132d-ebf0-4821-b0d0-d29d7d04439c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converting VIF {"id": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "address": "fa:16:3e:20:83:84", "network": {"id": "37c1446c-fef9-4e77-b417-92d2d10975f2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1529230261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688a0d377c874fd5956563906989b601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bf84d-48", "ovs_interfaceid": "9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.network.os_vif_util [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48') {{(pid=75279) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_vif [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48') {{(pid=75279) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9bf84d-48, bridge=br-int, if_exists=True) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=669a06e2-819f-468d-877a-8075e0327ab8) {{(pid=75279) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:10 user nova-compute[75279]: INFO os_vif [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:83:84,bridge_name='br-int',has_traffic_filtering=True,id=9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb,network=Network(37c1446c-fef9-4e77-b417-92d2d10975f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bf84d-48')
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] calling os-brick to detach iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f71f81f1330>, {'target_iqn': 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCZnoyqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 11 00:54:10 user nova-compute[75279]: WARNING os_brick.initiator.connectors.base [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629fc56-66cc-48ad-8cf1-f366fbd7af86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 11 00:54:10 user nova-compute[75279]: No targets found.
Nov 11 00:54:10 user nova-compute[75279]: iSNS:
Nov 11 00:54:10 user nova-compute[75279]: No targets found.
Nov 11 00:54:10 user nova-compute[75279]: STATIC:
Nov 11 00:54:10 user nova-compute[75279]: Target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278
Nov 11 00:54:10 user nova-compute[75279]:         Portal: 172.16.0.220:3260,-1
Nov 11 00:54:10 user nova-compute[75279]:                 Iface Name: default
Nov 11 00:54:10 user nova-compute[75279]: FIRMWARE:
Nov 11 00:54:10 user nova-compute[75279]: No targets found.
Nov 11 00:54:10 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 11 00:54:10 user nova-compute[75279]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 11 00:54:10 user nova-compute[75279]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75279) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278', 0)] {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75279) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e51bb81-a677-42a4-b856-0cfd70a9168f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:10 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2ae4e-1986-4ea1-b3da-7c568d84a510]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:54:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 (non-flash)
Nov 11 00:54:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f71e0709c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278'): ({'sdb'}, set())}) {{(pid=75279) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Removing single pathed devices sdb {{(pid=75279) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:54:11 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=24.977645874023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef80fd-1f8b-46fa-9617-4d383c4ef88d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7bdc71-59bd-4bfa-ad02-985ce0868b35]: (4, ('ok\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Flushing IO for device /dev/sdb {{(pid=75279) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680d080-9894-4afd-a18a-de9c3d79da5f]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75279) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c434f3b-5cbd-4f56-b551-113f87acd1ec]: (4, ('1', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.linuxscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] SCSI volumes sdb have been removed. {{(pid=75279) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278')] {{(pid=75279) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc695a82-e6c5-4de7-a1d7-313d77030210]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --logout {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c12ee-dec5-4c49-b431-827adf1fd01d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260]
Nov 11 00:54:11 user nova-compute[75279]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278, portal: 172.16.0.220,3260] successful.
Nov 11 00:54:11 user nova-compute[75279]:  stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op delete {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Instance b080132d-ebf0-4821-b0d0-d29d7d04439c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75279) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9886f12a-1761-463c-9479-816a4edc5278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb3a1f-f60c-43af-a73c-eca1bd2143c5]: (4, ('', '')) {{(pid=86651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75279) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.base [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.658s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] <== disconnect_volume: return (659ms) None {{(pid=75279) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Disconnected iSCSI Volume {{(pid=75279) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 11 00:54:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Deleting instance files /opt/stack/data/nova/instances/b080132d-ebf0-4821-b0d0-d29d7d04439c_del
Nov 11 00:54:11 user nova-compute[75279]: INFO nova.virt.libvirt.driver [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Deletion of /opt/stack/data/nova/instances/b080132d-ebf0-4821-b0d0-d29d7d04439c_del complete
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:54:11 user nova-compute[75279]: INFO nova.compute.manager [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo.service.loopingcall [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75279) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.manager [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Deallocating network for instance {{(pid=75279) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] deallocate_for_instance() {{(pid=75279) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:54:11 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG nova.network.neutron [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Updating instance_info_cache with network_info: [] {{(pid=75279) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 11 00:54:12 user nova-compute[75279]: INFO nova.compute.manager [-] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Took 0.47 seconds to deallocate network for instance.
Nov 11 00:54:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] Acquiring lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] No waiting events found dispatching network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 11 00:54:12 user nova-compute[75279]: WARNING nova.compute.manager [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received unexpected event network-vif-plugged-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb for instance with vm_state active and task_state deleting.
Nov 11 00:54:12 user nova-compute[75279]: DEBUG nova.compute.manager [req-eb0c6364-3036-4070-bb1b-aac757c84969 req-e2f51058-d56f-4a27-a353-3450f0356c93 service nova] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Received event network-vif-deleted-9a9bf84d-48e5-4b67-89ce-4fd6fafb95cb {{(pid=75279) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 11 00:54:12 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:13 user nova-compute[75279]: INFO nova.compute.manager [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] [instance: b080132d-ebf0-4821-b0d0-d29d7d04439c] Took 1.12 seconds to detach 1 volumes for instance.
Nov 11 00:54:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:54:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:54:13 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:54:13 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:54:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:13 user nova-compute[75279]: INFO nova.scheduler.client.report [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Deleted allocations for instance b080132d-ebf0-4821-b0d0-d29d7d04439c
Nov 11 00:54:13 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-4b3d0a30-af5f-4878-809e-53614fd689eb tempest-TestVolumeBootPattern-124063847 tempest-TestVolumeBootPattern-124063847-project-member] Lock "b080132d-ebf0-4821-b0d0-d29d7d04439c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:54:13 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:18 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:22 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:25 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:54:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:54:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:54:25 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:54:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:45 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:50 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:54:55 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:00 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:05 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:55:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:09 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:09 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75279) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Auditing locally available compute resources for user (node: user) {{(pid=75279) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 11 00:55:10 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:55:10 user nova-compute[75279]: WARNING nova.virt.libvirt.driver [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=24.976863861083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75279) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75279) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.provider_tree [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed in ProviderTree for provider: d9002de1-9e35-4b13-abf3-b4c27ac7a991 {{(pid=75279) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.scheduler.client.report [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Inventory has not changed for provider d9002de1-9e35-4b13-abf3-b4c27ac7a991 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75279) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG nova.compute.resource_tracker [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Compute_service record updated for user:user {{(pid=75279) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 11 00:55:10 user nova-compute[75279]: DEBUG oslo_concurrency.lockutils [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 11 00:55:11 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:12 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:12 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:14 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:14 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:15 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:15 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:17 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:19 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:20 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:25 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:27 user nova-compute[75279]: DEBUG oslo_service.periodic_task [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75279) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 11 00:55:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Starting heal instance info cache {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 11 00:55:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Rebuilding the list of instances to heal {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 11 00:55:27 user nova-compute[75279]: DEBUG nova.compute.manager [None req-8b5bda34-bcf9-439a-83ec-255c21ff2387 None None] Didn't find any instances for network info cache update. {{(pid=75279) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75279) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75279) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 11 00:55:30 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 11 00:55:35 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 11 00:55:40 user nova-compute[75279]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75279) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}